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I.  INTRODUCTION 

Reported  below  are  the  results  of  a  study  carried  out  at  the  Center  for  Communications 
and  Signal  Processing  Research,  at  the  New  Jersey  Institute  of  Technology,  between  April  1, 
1992  and  June  30,  1993.  This  research  is  a  continuation  of  previous  research  performed  during 
the  same  period  in  91/92  [l].  The  aim  of  the  research  is  to  further  analyze  and  evaluate  the 
performance  of  a  fast  adgorithm  known  as  the  “bootstrapped  algorithm.”  Historically,  the 
idea  of  the  algorithm  as  a  way  for  cancelling  interferences  was  first  proposed  by  the  principle 
investigator  in  1981  [2],  and  later  it  was  used  for  cancelling  cross  polarization  in  satellite 
communication  [3]  and  in  the  microwave  terrestrial  radio  line  [4-6]. 

The  bootstrapped  interference  canceler  is  principally  composed  of  two  separate  c:ancelers. 
each  using  the  output  of  the  other  canceler  as  its  reference  (desired  signal)  input.  In  fact, 
such  a  structure  performs  as  a  “Signal  Separator”  rather  than  an  interference  canceler.  Since 
for  its  operation  there  is  no  need  for  a  reference  signal,  it  is  sometimes  justifiably  called  a 
“Blind  Separator.” 

Three  different  structures  were  proposed  in  [1],  namely,  the  Backward/ Backward  (BB). 
the  Forward/Forward  (FF)  and  the  Forward /Backward  (FB).  They  are  depicted  in  Figures 
1,  2,  and  3.  The  different  weights  of  these  two-input /two-out put  separators  can  be  controlled 
by  minimizing  the  output  power  or  minimizing  the  absolute  value  of  the  cross  correlation 
between  the  two  outputs. 

During  the  first  phase  of  this  report  [l],  the  steady  state  behavior  of  these  separators  was 
examined.  It  was  shown  that  under  acceptable  conditions  they  converge  to  a  state  which 
represents  the  desirable  signal  separation.  The  effect  of  additive  noise  on  the  performance 
of  the  separator  was  also  studied  in  [Ij. 

It  was  also  demonstrated  that  extensions  of  all  three  structures  to  multi-input/multi- 
output  are  possible.  Such  extensions  are  particularly  important  in  multi-channel  communi¬ 
cation,  such  as  Code  Division  Multiple  Access  (CDMA)  applications  or  neural  networks. 
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Some  preliminary  work  on  the  applicability  of  the  algorithms  was  also  performed  and 
some  results  were  presented.  Special  emphasis  was  put  on  the  usage  of  the  three  structures 
in  handling  dually- polarized  signals  where  we  examined  the  error  probabilities  of  the  boot¬ 
strapped  cross-pol  cancelers  for  M-ary  QAM  signals.  Their  performance  was  compared  to 
other  kinds  of  cancelers  known  in  the  literature. 

It  was  concluded  that  the  bootstrapped  algorithms  have  many  useful  properties  which 
make  them  excellent  candidates  for  use  as  signal  separators  or  interference  cancelers  when 
other  algorithms  have  difficulties.  In  some  cases,  it  clearly  outperforms  other  algorithms. 
In  particular,  it  was  demonstrated  that  the  adgorithm  has  the  property  of  converging  to 
its  steady  state,  where  signal  separation  occurs,  much  faster  than  other  algorithms.  Unlike 
other  algorithms,  the  speed  of  convergence  does  not  depend  on  the  signals'  power  ratios  and. 
hence,  does  not  depend  on  the  eigenvalue  spread  of  the  input  correlation  matrix. 

During  the  current  phase  of  the  research  we  continue  to  examine  other  properties  and 
advantages  of  the  algorithm.  We  propose  and  study  some  applications  to  communication 
systems. 

First,  it  is  stated  that  the  different  structure  exhibits  a  different  level  of  complexity, 
particularly  when  it  is  used  in  very  high  frequencies,  as  in  microwave  communication.  They 
presents  different  delay  path  to  the  signals  tind,  hence,  have  different  system  bandwidth. 
This  raises  the  question  of  existing  complexity  -  bandwidth  trade-off. 

For  every  control  system  the  question  of  stability  of  the  steady  state  point  is  always 
asked.  This  is  of  particular  interest  with  the  bootstrapped  algorithms,  as  they  are  highly 
nonlinear. 

Clearly,  when  one  proposes  an  adaptive  algorithm,  it  is  crucial  to  suggest  an  adequate 
real-time  realization  of  the  recursive  control  of  the  weights.  Two  methods  of  dynamic  con¬ 
trol  are  studied.  One  uses  orthogonal  perturbation  sequences  and  is  applied  to  the  Back¬ 
ward/Backward  structure  and  controlled  via  the  power-power  criterion.  The  other  uses 
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weights  dithering  with  a  PN  sequence  and  is  applied  to  the  Forward /Backward  structure 
and  controlled  via  the  power-correlator  criterion. 

Delay  controlled  structures  of  the  bootstrapped  algorithms  were  also  proposed  in  [1].  In 
this  report  we  further  study  these  structures  and  examine  some  of  their  applications.  For  the 
multi-input/multi-output  application,  we  obtain  new  results  in  blind  separation  of  signals 
when  the  environment  is  dispersive. 

Possible  applications  of  the  algorithms  are  numerous.  Two  of  such  applications  are  in 
the  fields  of  blind  equalization  and  CDMA.  In  the  second  field,  which  will  be  studied  further 
in  the  future,  we  will  present  some  ideas  which,  although  they  are  not  implement  with  the 
bootstrapped  algorithm,  would  become  a  basis  for  comparison  with  these  cancelers  as  they 
are  applied  in  CDMA  systems. 

Section  (2),  below,  is  a  technical  summary  of  the  study  performed  in  this  phase  of  the 
research  and  its  results.  Detailed  reports  on  which  this  summary  is  based  are  given  in  the 
appendices  of  this  document.  Each  appendix  covers  a  specific  part  of  the  research  and  is 
written  in  a  way  that  can  be  read  independently  of  the  other  parts.  Section  (.3)  contains  the 
conclusions  and  recommendations  for  further  studies. 
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II.  TECHNICAL  SUMMARY 

2cl  Bootstrapped  Algorithm  -  Separation  of  Two  Superimposed 
Signals 

Figures  1,  2,  and  3,  the  configuration  of  the  three  bootstrapped  algorithms  for  separating 
two  superimposed  signals, 

Xi(f)  =  aiili(t)  +  ai2l2it)  +  ni{t)  (1) 

xjCO  =  +  022/2(0  + (2) 

where  xi{t)  and  X2(0  are  the  received  superimposed  signals  at  the  first  and  second  channels, 
respectively;  Ii(t)  are  the  two  data  signals  such  that  for  i=l,2  1;  is  an  M-ary  signal  from  set 
{±1,  -  1)};  and  a.j  i=l,2  are  channel  coupling. 

The  performance  criterion  used  in  controlling  the  cdgorithm  weights  are,  respectively,  the 
power-power,  correlation-correlation  and  power-correlation.  A  detailed  discussion  of  these 
criteria  and  their  corresponding  steady  state  values  is  given  in  [1  of  .Appendix  A]  and  the 
effect  of  noise  on  these  values  is  given  in  [1  of  Appendix  B].  Note  the  insertion  of  the  dis¬ 
criminator,  which  is  crucial  in  obtaining  unique  steady  state  points. 

2.1.1  Bandwidth  Complexity  Trade-OfF 

Comparing  the  steady  state  performance  for  the  three  systems  [1  of  Appendix  A]  showed 
that  the  symmetric  B/B  and  F/F  correlation  systems  have  identical  output  signals  and 
signal-to-interference  ratios,  while  the  asymmetric  B/F  system  has  slightly  different  out¬ 
put  signals  and  signal-to-interference  ratios  at  its  output  ports.  Nevertheless,  they  axe  all 
equivalent  in  that  the  desired  signal  separation  is  ideal  provided  certain  conditions  or  as¬ 
sumptions  cire  valid;  specific2dly.  when  the  effects  of  added  noise,  quantization  error,  and 
non-zero  circuit  delay  are  assumed  to  be  negligible. 

An  examination  of  Figures  1-3  illustrates  that  the  three  configurations  require  different 
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levels  of  hardware  complexity.  The  F/F,  correlation-correlation  scheme  is  expected  to  be 
the  most  complex  since  it  requires  correlators  with  zero  offsets,  while  the  B/B,  power-power 
scheme  is  the  least  complex.  Also,  the  three  canceler  systems  have  different  signal  paths 
through  the  individual  circuits  and,  thus,  when  they  are  applied  for  separation  of  duadly 
polarized  signals  directly  at  microwave  frequencies  [5],  or  high  I.F.  frequencies  (as  in  a  dual 
polarized  microwave  terrestrial  link  [4]),  different  system  delays  are  expected.  Therefore,  in 
Appendix  A  of  this  report  we  present  a  thorough  study  of  the  effects  of  these  delay  differences 
on  the  performance  of  each  of  the  different  cross-pol  separator  configurations.  In  particular, 
we  analyze  and  discuss  system  bandwidth  limitation  due  to  these  delays.  For  each  of  the 
three  different  schemes,  we  study  the  effect  of  delay  on  the  optimal  weights,  on  the  outputs’ 
powers  and  ratios.  These  effects  are  presented  in  terms  of  the  autocorrelation  of  the  two 
signals  as  well  as  the  mixing  ratios  at  the  superimposed  inputs.  Using  the  relation  between 
autocorrelation  and  signal  bandwidth,  we  estimate  the  different  separator  bandwidths  and. 
hence,  we  obtain  the  level  of  signal  bandwidth  limitation  that  each  separator  shows.  These 
bandwidth  limitations  are  presented  in  the  form  of  a  lower  bound  on  the  depth  of  cancellation 
as  a  function  of  both  signals’  bandwidths  and  system  delays.  The  results  obtained  in  this 
research  are  summarized  in  Tables  1-4  of  Appendix  A. 

Baised  on  these  results,  a  practical  example  from  a  typicai  14-18  GHz  microwave  circuitry 
shows  that  in  the  design  of  a  B/F  power-correlation  separator,  one  can  obtain  as  much  as 
20dB  input-output  improvement  in  the  signal-to-interference  ratio  (in  corresponding  to  a 
40dB  signal-to-interference  ratio  at  the  output  when  the  input  cross-pol  ratio  |ai2|  —  |a2il  — 
0.1  or  20dB),  when  the  signals’  bandwidths  are  of  the  order  of  500  MHz.  On  the  other  hand, 
with  the  same  assumption  regarding  the  accuracy  of  the  delay  timing,  we  can  achieve  almost 
34dB  improvement  (54dB  output  signal-to-interference  ratio),  if  the  signal’s  bandwidths  are 
only  100  MHz. 

The  B/B  power-power  scheme  can  handle  only  a  small  bandwidth.  In  fact,  the  power- 
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power  scheme  might  be  applied  with  reasonable  success  in  lower  frequency  low  bandwidth 
applications.  For  example,  if  the  frequency  band  is  in  the  4-6  GHz  range  then  the  delays  are 
of  the  order  of  1  ns,  so  that  20dB  input-output  improvement  in  signai-to-interference  can  be 
accomplished  with  approximately  8  MHz.  If  the  cancellation  is  performed  in  the  70  MHz  IF 
frequency  then  the  7r/4  wavelength  delay  needed  for  the  in-phase-quadrature  weighting  will 
restrict  the  delays  to  greater  than  3.5  ns.  If  we  assume  delays  of  5  ns,  the  bandwidth  will 
be  limited  to  approximately  2  MHz.  Notice,  however,  that  the  power- power  scheme  requires 
much  simple  hau'dware  than  the  other  two  schemes,  so  that  the  hardware  complexity  band¬ 
width  trade-off  is  exhibited. 

2.1.2  Stability  Consideration 

In  every  control  system,  adaptive  or  non-adaptive,  one  is  always  concerned  in  finding 
whether  the  steady  state  optimal  weight  solution  is  stable  or  unstable.  For  a  linear  dynamic 
system  this  is  done  by  examing  the  eigenvalue  of  the  corresponding  weight  control  equation. 
It  is  of  interest  to  examine  and  classify  the  steady  state  point  of  the  three  structures  proposed 
in  [l  of  Appendix  A].  However,  since  the  control  equations  for  the  bootstrapped  algorithms 
are  highly  nonlinear  they  require  special  attention.  This  is  done  in  Appendix  B  of  this  report. 

For  each  of  the  structures,  we  first  derive  the  steady  state  equilibrium  points  for  the  no 
noise  case.  These  are  respectively; 

1.  The  Backward/Backward,  Power-power  Scheme 
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3.  The  Forward/ Backward,  Power- Correlator  Scheme  (  assuming  #  ^); 
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The  stability  parameters  are  found  by  linearizing  the  control  equation  around  the  equi¬ 
librium  point  of  equations  (3)  to  (8).  This  linearization  process  leads  to  a  matrix  differential 
equation  of  the  form 

X=AAw  (9) 


where  Aw  =  [Au)i2,  Au;2i]^  and 

’5,Yi(u;i2  -I-  Au;i2,  1021  d"  ^0721)  dX2{'W\2  ■!"  Au;i2, 11721  -f  Au72i ) ''  ^ 


X  = 


dw 


12 


dw‘ 


21 


(10) 


where 


■  ^  d\X, 

dwi2  ’^opt  dwi2dw2l  '^opt 

^^Y2  ■  d^X2 

.  dwi2dw2l  ^opt  dw^i  '^opt 


(11) 


The  functions  Xi(-,  •)  and  X2(-,  •)  are  different  for  each  structure.  They  represent  the  de¬ 
riving  term  for  the  weights’  recursive  equations  and  depend  on  the  criterion  used.  Therefore 
(9)  describes  the  change  in  time  of  the  weights  deriving  terms  from  an  initial  Aw  away  from 
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the  optimal  weights.  If  for  example  the  eigenvalue  of  A  are  all  negative,  the  weight  deriving 
terms  •)  and  X2{-,  ■)  will  decrease  to  zero  and,  hence,  to  the  steady  state  point,  etc. 

The  stability  of  equilibrium  points  depend  on  the  eigenvalues  of  matrix  A.  Considering 
the  characteristics  equation  of  the  matrix  A  from  |AI  —  A|  =  0,  we  can  find  the  eigenvalues 
of  A  by  solving 

A2-bA+c  =  0  (12) 


where 


b  = 


dwi2  **"  dw^i 


(13) 


d^Xi ,  d^X2 
c  =  TT-T-lw, 


d^Xi 


d^X. 


(14) 


dwl2  op*'  dW2i  op^  dwi2dw2i  opl  dwi2dw2i  op*- 

The  nature  of  the  eigenvalues  of  A  in  the  complex  plane,  or  equivalently  the  relation 
between  b  and  c  defined  in  (13)  and  (14)  determines  the  classification  of  the  equilibrium 
point. 

After  finding  the  matrix  A  for  each  of  the  three  structures  and  for  both  equilibrium  points 
of  equations  (3)  to  (8),  we  determine  the  condition  for  the  stability  of  each  structure.  For 
the  symmetric  power-power  and  correlation-correlation,  it  was  found  that  YLiopt  (Eq-  (3)  and 
(5))  are  stable  provided  that  the  step  size  n  is  positive  and  the  effects  of  the  discriminators 
are  such  that 

621^12  >61 IS22  { 15) 

That  is,  the  discriminator  always  favors  different  signals  at  different  outputs.  Under  the 
same  conditions,  the  other  equilibrium  point  is  an  unstable  saddle  point. 

For  the  power-correlator  scheme,  a  stable  YLiopt  occurs  if  beside  the  condition  in  (15). 
the  effect  of  the  second  discriminator  is  such  that  it  is  more  pronounced  than  the  cross-pol 
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power; 


(16) 


622  £^{/i(n)}  Vail/ 

2.1.3  Dynamic  Studies 

With  any  adaptive  algorithm,  one  first  tries  to  define  the  performance  criterion  that  the 
algorithm  would  seek  to  optimize,  by  finding  the  control  weights  which  give  the  optimal 
performance.  However,  in  a  real  time  variable  environment  condition,  the  designer  must 
devise  a  suitable  algorithm  which  recursively  would  try  to  reach  the  steady  state  optimal 
weight  values.  For  the  bootstrapped  algorithms,  recursive  procedures  were  suggested  to 
simultaneously  control  the  two  weights.  They  require  the  knowledge  of  the  gradient  of  the 
output  power  (when  minimum  power  criterion  is  used)  or  the  gradient  of  the  square  of 
correlation  between  outputs  (when  minimum  correlation  is  sought).  Instead,  one  may  use  an 
estimate  of  the  gradient.  Such  possible  estimation  is  the  sample  vtilue  of  the  gradient.  .A.lso  a 
direct  real-time  measurement  of  a  gradient  of  a  random  variable  is  difficult  if  not  impossible, 
particularly  if  this  is  performed  with  signals  of  very  high  frequencies  as  in  communication 
applications. 

Without  direct  measurement,  we  present  in  this  report  two  techniques  for  reaching  the 
optimal  weights  with  a  recursive  weight-updating  procedure  using  estimates  of  the  gradients. 
With  the  first  technique,  the  estimates  of  the  gradient  are  obtained  by  applying  two  orthog¬ 
onal  perturbation  sequences  to  the  two  weights  simultaneously.  With  the  other  technique, 
the  weights  eire  dithered  with  PN  sequences.  These  are  described  next. 

2. 1.3.1  Dynamic  Study  of  B/B  Power-Power  Scheme  Using  Orthogonal 
Perturbation  Sequences 

Figure  (4)  presents  a  Backward/Backward,  power-power  scheme  of  a  cross-pol  interfer¬ 
ence  canceler  controlled  by  orthogonal  perturbation  sequences.  Two  such  sequences  p\{n) 
and  P2(n)  with  an  amplitude  A  (taken  to  be  sufficiently  small)  are  added  to  the  current 
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weight  Wi2(i)  and  W2i(i).  The  two  outputs  are  then  multiplied  respectively  by  pi(n)  and 
P2(n).  The  results  give  a  measure  of  the  corresponding  change  of  the  output  powers. 

In  Appendix  C  of  this  report,  we  analyze  the  control  structure  of  Figure  (4).  We  show 
that  the  estimate  of  the  gradient  obtained  with  the  perturbation  method,  converges  in  the 
mean  to  the  actual  gradient  and,  hence,  the  weights  converge  in  the  mean  to  the  optimal 
weight.  This  is  shown  by  examing  the  dynamic  behavior  of  the  error  between  the  estimated 
weight  <ind  its  desired  optimal  value.  The  condition  for  such  convergence  is  also  stated. 

2. 1.3. 2  Dynamic  Study  of  B/F  Power-Correlator  Scheme  Using  Weight  Dithering 
with  PN  Sequences 

Figure  (5)  presents  a  Backward/ Forward,  power-correlator  bootstrap  separator  with 
weight  dither  control.  A  PN  sequence  is  added  to  the  weight  lyj.  The  output  power  of 
!/i(t)  is  multiplied  after  eliminating  the  DC  component  by  the  PN  sequence.  A  low  pass 
filter  smoothed  the  control  signal  before  it  was  added  recursively  to  the  previous  weight 
value. 

In  Appendix  D  of  this  report  we  analyze  this  dither  control  structure.  Since  a  possible 
candidate  for  such  scheme  is  a  microwave  dual  channel  separator,  we  prefer  to  use  the  analog 
presentation  of  signal  instead  of  the  discrete  one.  Therefore,  we  examine  the  change  in  the 
weights  versus  time  instead  of  checking  convergence  of  the  recursive  equations.  We  found 
that  under  certain  conditions  which  relate  signals’  power,  system  gain  and  dither  magnitude 
the  dither  control  results  in  weight  steady  state  value  that  gives  signal  separation.  However, 
depending  on  the  magnitude  of  the  dither,  some  smaill  interference  residue  is  retained.  This 
sensitivity  of  the  quality  of  separation  to  power  of  dither  and  other  svstems  is  also  studied. 


2.2  Bootstrapped  Algorithms  —  Wideband  Signal  Separators 

In  [l],  we  performed  some  preliminary  study  in  applying  the  bootstrapped  algorithms  to 
wideband  signals.  There,  we  suggested  structure  whose  controlled  elements  are  delays  in¬ 
stead  of  complex  weights  or  digital  filters.  Two  applications  of  the  wideband  structures  are 
considered  in  Appendices  E  and  F  of  this  report. 

Figure  (6)  describes  the  scenario  where  two  wideband  sources  are  received  by  an  array 
of  two  sensors.  The  outputs  of  the  two  sensors  are: 

2\{t)  =  si{t  —  Di)  +  s^it  —  D2)  +  ei(t) 

Z2{t)  =  S\{t Di)  +  S2{t  +  D2)  ^2{t)  (1”) 

where  si{t)  and  S2{t)  are  the  signals  radiated  from  the  and  2nd  sources  respectively.  ei(0 
and  62(0  are  the  additive  noise  processes  in  each  of  the  sensors  and  Di  is  given  by, 

J 

Di  =  —sm9i  1  =  1.2  (18) 

d  is  the  distance  between  the  sensors,  c  is  the  propagation  velocity  and  ,  i  =  1 . 2  is  the 
bearing  of  the  ith  source.  We  assume  that  the  random  signals  S2{t),  erff)  and  62(0 

are  mutually  statistically  uncorrelated. 

In  fact,  the  model  described  above  is  applicable  to  many  communication  and  signal  pro¬ 
cessing  problems  which  can  be  put  in  three  groups:  bearing  estimation  (source  localization), 
source  separation,  and  interference  cancellation. 

•  For  bearing  estimation  (source  localization)  one  is  interested  in  Di  and  D2  and  not  in 
the  signal  estimates  Ji(t)  and  S2it).  In  this  application,  particularly  in  active  radar  or 
sonar,  much  is  known  about  Si(<)  and  S2{t). 

•  For  source  separation,  the  objective  is  to  get  the  cleanest  possible  version  of  ■•ii(t)  and 
S2{t),  while  D\  and  D2  are  nuisance  parameters.  Indeed,  in  some  cases  there  is  some 
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prior  knowledge  about  B\  «ind  which  can  be  used  to  restrict  the  possible  values  of 
D\  and  Di- 

•  For  interference  cancellation,  the  objective  is  to  get  a  clean  replica  of  one  of  the  signals, 
say  3i{t)  while  the  other  signal,  as  well  as  D\  and  D2  axe  nuisance  parameters  which, 
in  some  applications,  are  partially  known. 

In  Appendix  E  of  this  report  we  present  adaptive  systems  which  receive  zi{t)  and  Z2(t) 
at  the  input,  deliver  as  output  signals  yi{t)  =  3i{t)  and  y2{t)  =  h{t),  and  simultaneously 
provide  the  estimates  of  Di  and  Dj  from  which  the  bearings  of  the  two  signals  and  82  can 
be  derived.  However,  in  order  to  enable  separation,  some  information  (statistical  or  physical) 
about  the  signals  Si(t)  and  S2{t)  is  required.  This  information  will  be  utilized  in  the  design 
of  the  control  loop.  It  enables  initiation  of  the  separation  procedure.  If  further  information 
is  available  (such  as  knowledge,  for  example,  of  one  of  the  two  bearings)  the  same  algorithm, 
which  then  bootstraps  itself,  will  result  in  performance  improvement. 

Two  different  configurations  of  the  delay  control  bootstrapped  separation  adgorithm  are 
given  in  Figure  (7);  for  the  Backward/ Backward  and  Forward/ Forward  structures.  They 
are  examined  using  small-error  analysis  of  the  outputs  spectra.  It  is  shown  that  while  both 
configurations  are  able  to  perform  simultaneous  source  separation  and  delay  estimation  ( and 
hence  direction-of-arrival),  they  exhibit  several  differences. 

1.  In  the  ideal  situation,  i.e.,  when  pi  =  Ti  —  Di  =,  (r^  is  the  controlled  delays)  is  zero  for 
i=l,2.  The  BB  configuration  provides  undistorted  versions  of  the  signal  waveforms, 
while  the  FF  configuration  decouples  the  signals  but  provides,  at  the  outputs,  a  filtered 
version  of  them.  Therefore,  if  an  exact  replica  of  the  source  signed  is  needed,  the  BB 
configuration  is  to  be  preferred. 

2.  In  the  presence  of  additive  noise,  the  FF  configuration  provides  better  estimates  of 
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the  unknown  source  directions  (the  delays)  than  the  BB  configuration.  Thus,  the  FF 
structure  is  better  for  direction  of  turival  (DOA)  estimation. 

3.  The  BB  configuration  exhibits  difficulties  in  the  presence  of  noise  when  applied  at 
baseband. 

In  comparison  to  n2Lrrowband  separators,  we  conclude  the  following: 

1.  The  F/B  configuration  can  only  be  implemented  in  the  narrowband  case. 

2.  Unlike  the  narrowband,  when  the  B/B  separator  is  used  in  the  broadband  case,  decor¬ 
relation  cannot  be  replaced  by  minimization  of  the  output  powers. 

3.  If  the  signals  are  only  known  to  be  uncorrelated  and  have  the  same  spectrum,  then,  eis 
in  the  narrowband  case,  a  discriminator  is  needed  to  achieve  separation.  If.  however, 
their  spectrum ’s  known  to  be  different,  then  such  a  discriminator  is  unnecessary. 

In  Appendix  F  of  this  report  we  present  a  noval  approach  for  rejecting  a  broadband 
interference  from  unknown  direction  when  received  by  an  array  of  two  sensors.  Two  config¬ 
urations  of  such  an  approach  are  presented.  Both  perform  perfect  interference  cancellation 
when  the  input  signal-to-noise  ratio  (SNR)  is  large  enough,  cind  do  it  much  faster  than  LMS 
canceler.  However,  additive  noise  causes  performance  degradation  to  both.  It  is  shown  that 
no  general  claim  can  be  made  about  the  superiority  of  one  configuration  with  respect  to 
the  other.  The  output  signal  to  interference-plus-noise  ratio  (SNIR)  depends  on  the  spatial 
separation  between  the  interference  and  the  desired  signal,  as  well  as  on  the  interference-to- 
noise  ratio  (INR),  in  a  different  manner  for  both  configurations.  This  appendix  also  contain 
guidelines  for  the  choice  of  one  or  the  other  configuration  in  different  scenario. 
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2.3  Bootstrapped  Algorithms  -  Multi-Input,  Multi-Output 

Separators 

In  many  applications  such  as  in  neural  networks  and  signal  separation  in  multi  channel 
CDMA,  there  is  a  need  for  multi-input,multi-output  separators.  Extension  of  the  two- 
input /two-output  separators  was  suggested  and  its  performance  was  exeunined  in  [1  of  Ap¬ 
pendices  E  &:  F].  However,  emphasis  was  put  on  nondispersive  channel.  In  Appendix  G  of 
this  report,  we  studied  the  performance  of  the  back  ward/ for  ward  structure  when  it  separates 
multi-signal  composites  in  a  multi-channel  dispersive  environment. 

2.4  Bootstrapped  Algorithm  -  Other  Applications 

Beside  the  application  of  the  bootstrapped  algorithm  to  cross-pol  cancellation  which  was 
considered  in  [1]  and  in  this  report,  initial  work  was  performed  in  this  phase  of  research  in 
two  important  applications,  blind  equalization  and  spread-spectrum  multi-signals  separation. 
The  first  is  important  particularly  in  time  division  multiple  access  (TDMA)  and  the  other 
in  code  division  multiple  access  (CDMA)  communications. 

Decision  feedback  is  generally  preferred  to  other  equ2dization  methods,  as  it  can  com¬ 
pensate  amplitude  distortion  with  minimal  noise  enhancement.  This  structure  is  therefore 
used  in  our  research.  Decorrelation  of  the  equalizer  output  is  taken  as  performance  criterion. 
As  such  this  is  a  noval  way  of  equalization  which  demonstrate  many  advantages  (see  Figure 
(8))- 

In  Appendix  H,  we  show  that  this  blind  equalizer  converges  to  correct  equilibrium  despite 
error  propagation.  It  is  also  shown,  using  simulation,  that  the  algorithm  converges  to  the 
right  equilibrium  regardless  of  the  initial  condition,  and,  hence  it  is  globally  convergent. 

In  Appendix  I  of  this  report  we  included  the  results  of  research  within  adaptive  scheme 
which  separates  two  CDMA  signals  (see  Figure  (9)).  Although  it  does  not  show  bootstrap¬ 
ping  phenomenon,  it  is  rather  different  from  the  other  canceler  schemes  in  that  it  contains 
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decisions  in  the  cancellation  path.  This  study  would  be  used  in  the  future  as  a  reference  for 
comparison  with  the  bootstrapped  scheme  for  CDMA  signal  separators. 

III.  CONCLUSIONS  AND  RECOMMENDATIONS 

In  the  period  of  this  report  we  continue  to  analyze  and  evaluate  performance  of  the  boot¬ 
strapped  algorithms.  As  in  the  previous  year’s  work,  reported  in  [1].  we  considered  the 
three  different  structures,  the  B/B,  the  F/F  and  the  B/F.  It  was  then  concluded  mat  the 
algorithms  result  in  signal  separations.  Also  noted  that  unlike  other  algorithms,  the  speed 
of  convergence  does  not  depend  on  the  signals'  power  ratios  and  hence  does  not  depend  on 
the  eigenvalue  spread  of  the  input  correlation  matrix.  Furthermore,  the  algorithms  do  not 
require  supervisory  reference  and,  hence,  deserve  to  be  named  blind  signal  separator. 

In  this  research,  we  first  considered  the  question  of  bandwidth  each  of  the  three  structures 
can  tolerate.  It  was  found  that  both  the  F/F  and  the  B/F  can  be  made  reasonably  wideband 
if  it  is  used  at  microwave  or  higher  band.  The  B/B  is  quite  limited  in  bandwidth.  The 
former  structure  require  correlator  in  its  implementation  while  the  later  require  only  power 
measurement,  hence,  we  concluded  on  complexity  -  bandwidth  trade-off. 

The  question  of  stability  was  also  addressed.  Linearization  around  the  steady  state  point 
led  us  to  conclude  that  values  of  optimal  weights  which  result  in  signal  separation  are  stable 
points. 

Two  schemes  of  real-time  control  of  the  weights  were  proposed,  one  uses  orthogonal 
perturbation  sequences  and  the  other  weight  dithering  with  PN  sequences.  Both  showed 
satisfactory  results  in  that  the  weights  converge  in-the-mean  to  their  optimal  values. 

Using  delay  control  for  wideband  application,  we  show  that  the  algorithms  could  perform 
simultaneous  spatial  separation  of  wideband  signal  while  estimating  their  direction  of  arrival. 
It  was  also  shown  that  delay  controlled  bootstrapped  structure  can  successfully  be  used  to 
cancel  wideband  interferences. 
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In  the  extension  to  multi-input/multi-output,  we  show  that  the  algorithms  can  be  used 
also  to  handle  dispersive  environment. 

Finally  we  note  that  the  previous  research  dealt  madnly  with  dual  channel  cross-pol  in¬ 
terference.  This  report  contains  some  results  related  to  the  problem  of  blind  equalization  of 
digital  data.  It  also  contains  an  adaptive  canceler  for  CDMA,  which  would  become  basis  for 
comparison  in  future  research  when  the  bootstrapped  algorithm  is  used. 

The  work  carried  out  led  us  to  make  number  of  recommendations  for  further 
study. 

a.  Adaptive  Algorithms  -  Impletementation 

We  suggest  further  study  of  the  theoretical  and  practical  aspect  of  implementing  the 
bootstrapped  algorithms.  In  particular, 

•  Suggest  specific  control  strategies  to  adjust  the  weights/time  delays  of  the  bootstrapped 
edgorithm  for  the  two- input /two-output  configuration. 

•  Study  convergence  properties  of  the  algorithm  for  the  multi- input /multi-output  case. 
Specifically,  we  will  determine  the  feasibility  of  using  dithering  of  the  weights  to  improve 
convergence  and  enable  time- multiplexing  of  control  hardware. 

•  Continue  to  investigate  the  link  between  eigenvalue  spread  and  performance  of  the 
bootstrapped  algorithms. 

b.  Application  to  Signal  Separation  in  Satellite  Communication 

•  Further  examine  the  possibility  of  cross-pol  cancellation  in  satellite  communication 
channels.  Extend  the  current  results  obtained  with  M-ary  QAM  dual  polarized  signal 
to  other  possible  modulation  schemes. 

•  Develop  the  algorithm  for  handling  signals  such  as  frequency  hoppers. 
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•  Examine  the  effect  of  multipath  of  signal  separation  performance. 

•  Improve  the  quality  of  separation  of  code  division  multiplexed  signals. 

c.  Adaptive  Blind  Equalizer 

Bootstrapped  algorithms  in  particular  the  minimum  correlation  schemes,  are  good  can¬ 
didates  for  blind  equalizer,  therefore,  we  propose 

•  Investigate  the  application  of  the  bootstrapped  cdgorithms  to  the  blind  decision  feed¬ 
back  equalizer. 

•  Study  the  performance  of  such  a  scheme  md  compare  it  with  the  performance  of  the 
blind  feed  forward  equalizer  and  the  regular  (non-blind)  decision  feedback  equalizer. 

•  Examine  convergence  property  of  the  algorithms. 

•  Examine  ill  convergence  of  the  algorithm,  and  the  conditions  for  false  lock. 

d.  Application  of  Neural  Networks 

The  bootstrapped  tilgorithms  can  be  applied  as  a  new  leaning  paradigm  and  topological 
structure  for  designing  a  new  class  of  neural  networks.  This  new  class  of  neural  networks  has 
the  potential  to  revolutionize  and  improve  various  existing  applications  in  the  field  of  neural 
networks.  Fast  convergence,  the  self-organizing  property,  and  reference  signals  which  are  no 
longer  required,  are  among  the  major  advantages  that  should  be  verified  and  investigated. 
In  particular,  we  propose 

•  Map  the  bootstrapped  algorithm  onto  a  neural  network  framework.  The  resulting 
network,  which  belong  to  the  class  of  recurrent  self-organizing  neural  networks,  will  be 
referred  to  as  the  generalized. 
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•  Demonstrate  supremacy  of  the  bootstrapped  network  in  terms  of  performance,  conver¬ 
gence  and  stability  of  the  network  will  not  only  be  demonstrated  through  simulations 
but  we  will  attempt  to  prove  it  analytically  as  well. 

•  Explore  potential  applications  including  channel  equalization,  separation  of  superim¬ 
posed  signals,  pattern  recognition  and  prediction. 


e.  Demonstration  Modules  for  Signal  Processing  Workstation  It  is  important  to 
try  emd  build  software  modules  for  each  of  the  applications  suggested.  It  is  proposed  to  use 
COMDISCO  Signal  Processing  Workstation  (SPW)  version  3.0.  for  these  modules. 
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Disciiminator 


Figure  I  The  Power-Power  Cross-Pol  Interference  Canceler. 
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Figure  2  The  Correlator- 


Figure  4  Power-Power  Cross-Pol  Interference  Canceler  controlled  by  orthogonal 

perturbation  sequences. 
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Figure  5  A  diagram  of  the  Forward/Backward  bootstrap  blind  signal  separator  with 

dither  control. 
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Figure  7  The  different  structures  of  the  delay  control  separators  -  (a)  the  basic  BB  structure, 
(b)  the  modified  BB  structure,  (c)  the  basic  FF  structure,  (d)  the  modified  FF  structure. 
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Adaptive  Control 


Figure  8  Channel  and  DFE  model. 
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Figure  9  Two-stage  receiver  for  two  synchronous 


APPENDIX  A 

BOOTSTRAPPED  ADAPTIVE  SEPARATION  OF  TWO 
SUPERIMPOSED  SIGNALS  - 
BANDWIDTH  COMPLEXITY  TRADE-OFF 


by 

Yeheskel  Bar-Ness 


I.  INTRODUCTION 

Three  different  bootstrapped  systems  were  introduced  in  [l]  for  the  purpose  of  cross¬ 
polarization  (cross-pol)  interference  cancelation  and  signal  separation.  They  differ  by  the 
criterion  used  to  determine  the  performance  index  for  realizing  the  optimum  weight,  gain  and 
phase  for  each  canceler  module  (e.g.,  minimization  of  each  of  the  interfering  signal  powers 
at  the  output  separately  or  the  correlation  between  the  two  different  outputs).  The  three 
systems:  power-power,  correlation- power  and  correlation-correlation  cancelers  are  shown  in 
Figures  1-3.  A  detailed  steady  state  analysis  of  these  sepeirators  is  included  in  [2].  It  was 
shown  in  [2]  that  each  of  these  cancelation  arrangements  results  in  a  power  separation  (a 
highly  desired  signal-to-interfering  signal  ratio  at  both  output  ports). 

Since  there  is  no  need  for  a  supervisory  reference  signal  in  the  form  of  a  training  sequence, 
decision  feedback,  etc.,  these  separators  are  in  the  category  of  blind  separators.  Comparing 
the  steady  state  performance  for  the  three  systems  showed  that  the  symmetric  power-power 
and  correlation-correlation  systems  have  identical  output  signals  and  signal- to- interference 
ratios,  while  the  asymmetric  power-correlation  system  has  slightly  different  output  signals 
and  signal-to-interference  ratios  at  one  of  its  output  ports.  Nevertheless,  they  are  all  equiva¬ 
lent  in  that  the  desired  signal  separation  is  ideal  provided  certain  conditions  or  assumptions 
are  valid;  specifically,  when  the  effects  of  added  noise,  quantization  error,  and  nonzero  circuit 
delay  are  assumed  to  be  negligible. 
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Since  the  introduction  of  the  bootstrapped  idea  for  signal  separation  (power-power)  in 
[3],  the  three  different  bootstrapped  scheme  has  been  proposed  and  implemented  for  dif¬ 
ferent  applications.  In  particular,  the  power-correlation  scheme  was  used  in  dual  channel 
downlink  cross-pol  canceler  operating  over  the  COMSTAR  satellite  system  [1].  Later,  the 
same  scheme  was  included  in  the  design  of  the  cross-pol  canceler  for  dual-channel  terrestrial 
digital  microwave  radio  communication  [4].  The  power-power  scheme,  on  the  other  hand, 
was  proposed  for  tactical  communications  application  in  [5].  Other  references  related  to 
the  performance  of  the  bootstrapped  signal  separator  (interference  cancelation)  including 
extension  to  the  multi-signals  case  are  contained  in  [6]- [9]. 

Independently  during  the  mid-eighties,  a  group  of  European  researchers  addressed  the 
separation  problem,  in  particular,  for  neural  networks  applications  (see  [10]  for  reference  to 
these  works).  Recently,  a  third  group  of  signal  processing  researchers  applied  a  similar  idea 
to  speech  signal  separation  [11]. 

Examination  of  Figures  1-3  illustrate  that  the  three  configurations  require  different  levels 
of  hardware  complexity.  The  correlation-correlation  scheme  is  expected  to  be  the  most 
complex  since  it  requires  correlators  with  zero  offset,  while  the  power-power  scheme  is  the 
least  complex.  Also  the  three  canceler  systems  have  different  signals'  paths  through  the 
individual  circuits  and  thus,  when  they  are  applied  for  separation  of  dually  polarized  signals, 
directly  at  microwave  frequencies  [1]  or  high  I.F.  frequencies  as  in  dual  polarized  microwave 
terrestrial  links  [4],  different  system  delays  are  expected. 

The  purpose  of  this  paper  is  to  examine  the  effect  of  these  delay  differences  on  the 
performance  of  each  of  the  different  cross-pol  separator  configurations.  In  particular,  any 
bandwidth  limitation  due  to  these  different  delays  is  analyzed  and  discussed. 

In  the  next  three  sections  of  this  paper,  we  consider,  respectively,  the  power-power,  the 
power-correlator  and  correlator-correlator  schemes.  In  each  section  we  study  the  effect  of 
these  delays  on  output  powers.  Power  ratios  are  considered  next.  In  particular,  the  lower 
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bound  on  system  bandwidth  is  estimated  and  used  to  calculate  the  bounds  on  input-output 
improvement  in  signal- to- interference  ratios.  Assuming  uniform  input  signal  spectra,  the 
actual  system  bandwidth  and  the  improvement  signad-to-noise  ratios  are  caJculated.  Finally, 
in  section  V  the  results  are  summarized  and  compared.  Numerical  examples  are  depicted 
to  show  the  suitability  of  the  different  schemes  to  different  applications.  It  is  important  to 
emphasis  that  in  our  analysis  we  will  use  the  assumption  that  delays  are  quite  small  relative 
to  the  signals’  correlation  times. 

II.  THE  POWER-POWER  SCHEME 

Figure  1  depicts  the  separator  structure  termed  power-power.  That  is.  the  corresponding 
separator  weights  are  chosen  to  minimize  the  powers  at  the  two  outputs  respectively.  In  this 
section,  we  will  examine  the  effect  of  system  delays  on  the  optimal  weights,  on  the  outputs’ 
power  and  ratios  and  finally  conclude  with  the  level  of  bandwidth  limitation  as  a  result  of 
these  delays. 

2.1  Effect  of  System  Delays  on  the  Optimal  weights 
Directly  from  Figure  1,  we  can  write 

Vp{t)  =  s{t  -  Ti)  +  lm{t  —  Ti)  -I-  ^cs{t  -Ti  -  T2)  -1-  3n(t  -  2ti  -  T2) 

+af3vp{t  -  2ti  -  2t2)  (1) 

where  we  used,  i;i(f)  =  s{t)  -H  bn{t),V2{t)  =  cs{t)  -t-  n(t)  as  the  two  inputs  (in  complex 
notation),  b  and  c  are  complex  valued  with  |6p  and  jcp  as  the  input  interference  coupling 
ratios,  and  T2  represent  the  path  delays  as  they  are  depicted  in  Figure  1.  q  and  3  are 
the  complex  weights  controlled  by  the  two  processors.  The  signal  s{t)  and  n{t)  are  assumed 
to  be  zero-mean  uncorrelated  stationary  complex  processes.  In  cross-pol  signals  separation 
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applications  ]  b  \  and  |  c  |  are  much  smaller  than  one.  Using  (1)  we  can  easily  find 


\vj,{t)-al3vj,{t~2n-2T2)\^  =  {l  +  \a0\^)P-2Real[al3]R^^i2Ti-\-2T2) 

=  (I  +  +  2i2ea/[/?c]/?,(ri  +  rj) 

(|6P  +  \^\^)W  +  2Real[0b’]R^{T,  +  r^)  (2) 

where  the  overb2U‘  stands  for  the  expected  value  and  /2v,(t), /2,(r)  and/l„(r)  are  the  auto¬ 
correlation  function  of  the  output  stochastic  processes  vJt),  the  signal  s(t)  and  the  signal 
n(t),  respectively  and  P  =  |  Vp(t)  p. 

Equation  (2)  can  be  rearranged  to  become, 

\l-al3\^P  +  2Real[a0]{P-R,^{2n-2T2)) 

=  |I  +  ^c|^|3|^  -  2fleo/(^cJ(|s|*  -  /f,(Ti  +  rj)) 

+  |(J  +  6|W-2J?eoi(/34-l(WF-ft.(r,+r,)).  (3) 

Notice  that  when  ri  =  r2  =  0  (ideal  case)  then 

li  +  ./?cp|7F-n/?-h  w 

The  same  equation  was  obtained  in  [2].  There,  we  showed  that  optimal  weight,  3  =  —b 
and  perfect  cancelation  of  the  n  signal  results.  However,  for  Tj  and  T2  #  0,  if  we  assume 
|a(  <<  1  and  \0\  «  U  then  the  second  term  on  the  left  hand  side  of  (3)  can  be  neglected. 
For  the  same  reason  the  second  term  on  the  right  hand  side  might  be  neglected,  particularly 
if  Tj  +  t2  is  suflSciently  small,  leaving 

„  ,  |1  +  Sc\‘W  +\I3  +  -  2fleal[/36-l(A„(r,  +  r,)) 

|l-aap 

where 

K{r)  =  \n\^  -  Rnir)  (6) 

^Such  assumption  on  |  a  |  and  |  |  is  reasonable  in  cross-pol  applications  where  in  |  6  |  and  )  c  |<<  1  and 

when  the  weights  are  close  to  their  optimal  weight 
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and  the  asterisk  denotes  complex  conjugate. 

To  find  the  optimal  value  of  the  weight  0  we  equate  to  zero  the  derivative  ^  of  the  output 
power  after  processing  by  the  discriminator;  Pi,  with  respect  to  /3: 

5Pi  2(1  -  a/?)[(l  +  ^c)(a  +  c)*<5,il7p  +  (6  +  /?)-(!  +  af3)SniW  -  (b-h  a’3b‘)Snii\nin  +  ^2))] 


dl3  |1  -  a0\* 

{-) 

where  6,1  and  6ni  depict  the  effect  of  the  discrimination  network  at  output  P  and  the 
derivative  of  a  real  function  P  with  respect  to  a  complex  variable  3  is  defined  by  dPld3  = 
dPjd^R  +  jdPId^i.  3ft  and  3[  are  the  real  and  imaginary  part  of  3  and  j  = 

From  dPi  183  =  0  we  get  after  certain  manipulation 


3op  =  - 


(g  +  c)*6,i|3P  +  6(1  +  a6)*^nlhP  —  ^^nl(|n|^  -  Rnin  +  T2)) 
c(g  +  c)’6,ilsP  +  (1  +g6)-5„iln|2  -  g*6*(5„i(|n|2  -  R^(ti  +  73)) 


(g  -H  c)-^',i|s|M-  bSnijR^ri  +  r^)  + 

c(g  +  c)‘5,il5|2  +  ^„i|n|2  +  g-6-6„iPn(ri  +  Tz) 

Notice  that  in  contrast  to  the  ideal  case  we  cannot  easily  conclude  that  perfect  cancelation 
of  the  n  signal  take  place. 

Using  similar  steps  we  obtain,  for  the  output  at  the  other  port, 


Q  =  IU7P  ^ 


where 


|1  -f  g6p|np  +  |c  +  gp|sp  -  2PeQ/[gc)(A,(ri  +  73)) 
jl  —  Oi?|^ 


■^*(’’)  =  |5p  -  P,(r) 


When  7i  =  73  =  0  (ideal  case)  then 

^  _  |1  -f  /?cp|nP4-  |c-f  g|^|sP 
^  \l-a3\^ 

^In  obtaining  the  complex  derivative  of  a  real  function  A  =  \d  +  e6\^  with  respect  to  the  complex  variable 
6  we  used  the  simple  general  rule  dA/d6  =  2e’{d-^e6) 
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From  equating  to  zero  the  derivative  of  the  output  power  after  processing  by  the  second 
discriminator,  Qi  we  have 


“  6(6  +  /J)-6n2RF  +  (1  +  C;3)-^.2R^  -  C-;^-6,2(j7F  -  /?,(n  +  Tj)) 

{b  -H  mn2\^  c6,2mn  +  r^)  +  c'$-S,2W) 

6(6  +  /9)-6„2ln|2  +  6,2|5P  +  c‘0-6,2Rs(ri  +  T2) 

where  6„2  «^d  6,2  show  the  effect  of  the  discriminator  at  output  Q. 

We  notice  in  (8)  and  (12)  that  Oop  and  dop  depends  on  Ti  +r2.  To  examine  this  dependency, 
we  define 

l^op  =  y^o  +  Cl  (13) 

Qop  —  Oto  +  ^2  ( 1  -1 ) 

where  l3o  and  q<,  are  the  corresponding  optimal  weight  when  =  r2  =  0.  It  is  easily 
noticeable  from  (8)  and  (12)  that  0o  —  —6  and  Oo  =  -c.  In  which  case  a  perfect  cancelation 
of  the  interferences  at  both  ports  is  obtained.  Also,  it  was  demonstrated  in  [2]  that  these 
values  will  be  attainable  by  the  system  if  a  search  algorithm  is  used,  and  appropriate  signals* 
discrimination  networks  2Lre  implemented. 

Using  (13)  and  (14)  will  result  in  a  set  of  nonlinear  equation  in  Ci  emd  €2,  which  become 

linear  if  we  neglect  certain  second  order  terms.  Using  the  smallness  condition  on  c  and  6. 

and  the  fact  that  Ti  +  rj  are  quite  small  relative  to  signals’  correlation  times  (but  not  zero). 

we  finally  find  in  Appendix  A-1  the  approximate  solution  for  these  linear  equations,  namely 

^  _  6(1  +bc)’Snl  -c*(l  +  bc)6,i{X,{Ti  +T2)/K{Ti  +T2)) 

^  (1  -  c6)*(p/6,2)|n|V'^n(7-i  +  r2) 

^  _  c(l  +  6c)*6,2  -  6‘(1  4-  6c)6n2(An(ri  -h  T2)/\,{Ti  +  T2)) 

(1  -  cb)-{p/8nl)\s\'^/K{Ti  +  T2) 

where 


P  —  ^s2^nl  ~  ^»l6n2 
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It  is  obviously  assumed  that  ^  ^  0.  Notice  *  hat  in  tne  case  where  tj  =  T2  =  0.  A,(  ti  )  = 
+T2)  =0  and  hence  ci  =  0  and  C2  =  0  is  the  unique  solution  for  the  linearized  equation 
in  Cl  and  £2-  This  solution  corresponds  to  the  perfect  cancelation  case. 


2.2  Effect  of  System  Delays  on  Outputs’  Powers  and  Ratios 

Thus  far  we  have  considered  the  effect  of  the  system  delays  on  the  optimal  weights.  To 
find  the  effect  of  this  delay  on  the  power  outputs  £ind  the  outputs  power  ratio  and  therefore 
on  the  depth  of  cancelation,  we  first  notice  from  (5)  together  with  (13)  that  the  power  of 
the  s-signai. 


Ps  = 


11  -c6p!n-c£i/(l  -  c6)p|sP 


|1  -aJ|2 

Using  (15)  and  the  fact  that  |  c  |<<  1  and  |  6  |<<  1  one  can  show  that  cei/(l  —  cb)  can  be 


neglected  leaving 


Ps^ 


|l-a/5|2' 

From  (5)  the  power  of  the  n-signal  is  given  by, 


(18) 


Pn  =  |yi3  +  6i'‘‘tn|2  -  2i?ea/[;36*]An(rx  +  r2) 

~  1/3  +  +  2j6)^A„(ri  +  72)  (19) 


In  the  last  step  we  applied  the  results  established  in  Appendix  (A-2)  namely:  Real\3h']  ~ 
— 16)^.  Using  J  4-  6  =  £1  and  (15)  for  £1  into  the  corresponding  terms  of  (5)  we  end  up  with 


P 

n  — 


1 


1  -ad|2 


6(  1  4-  bc)“Sni  —  c*(  1  +  6c)<55i(  Aj/ A„ ) 


m 


(•20) 


{l-bcr{p/S,2)\n\VK 

Also,  in  the  interest  of  brevity  and  when  it  is  cle^u■ly  understood  we  sometimes  drop  the 
dependence  of  the  A’s  on  the  delay  tj  4-72.  Notice  that  the  first  term  of  (20)  depends  inversely 
on  (|nP/A„)^  while  the  second  one  depends  inversely  on  (lnp/A„).  From  the  discussion  in 


Appendix  (A-3),  we  conclude  that  for  almost  all  values  of  |nP/A„,  (20)  is  dominated  by  the 
second  term  of  its  left  hand  side. 
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The  3-signal  to  n-signal  power  ratio  is  obtained  form  (18)  and  (20)  with  the  ciforemen- 

tioned  conclusion,  _ 

P./P.  ^  , 

216r 

But  |1  —  6cp  1  2md  if  lsP/|nP  2;  1  then 

{P.IP.Ub  =  (I^/An(r.  +  r,))js  -  3jb  -  |6|3g  (22) 

That  is,  the  input-output  improvement  in  the  s-signal  to  the  n-signal  is  upper- bounded  by 
10  log  [(l/2)|n|VAn(Ti  -H  rj)]. 

Because  of  symmetry  we  conclude  easily,  by  using  (8)  for  the  Q  port,  that 


Jl — ^|n|2 

|l-a)d|2'  ' 


(23) 


1 


11  -a/?|2 


C(  1  -j-  bcYSsj  ~  ^*(1  +  hc)6n2{^nl ^a) 


(1-c6)-(p/5„OMIVA. 


7-T?  ,  2|c|2  j— 


s  Y  -(- 


Using  the  same  previous  argument,  we  end  up  with 


Qn/Qa  ^ 


|1  -  6c|2l3P/A,(ri  -h  Tj)  rrni /TTTI' 


2|c| 


[\n\VU 


(24) 


(25) 


Also  since  |1  —  6cp  ~  1  and  if  lnP/|sP  ~  1  then 


{Qn/Qa)dB  ^  +  T2))<iB  “  ^dB  “  \c\Ib 


(26) 


That  is  an  input-output  improvement  of  l0log(l/2)|sp/A,(ri  -t-  T2)  in  the  n-signal  to  the 
s-signal  power  ratio.  Cle^ly  when  ti  =  r2  =  0  (no  delay)  we  have  an  infinitely  large  im¬ 
provement  which  corresponds  to  the  ideal  perfect  cancelation. 


2.3  Bandwidth  Limitation 

Most  of  signals  communicated  via  dual  polau-ization  cure  of  very  wideband  nature.  There¬ 
fore  it  is  very  important  for  these  applications  to  estimate  the  separator  bandwidth.  To 
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obtain  the  system  bandwidth  limitation,  we  first  notice  using  Taylor  series  expansion  that, 
for  example: 

Kin  +  r^)  =  R  -  iln(O)  -  in  +  r2)  (0)  -  (l/2)(ri  +  RAO)  -  ■  (27) 

where  the  dots  stand  for  the  derivatives  with  respect  to  tj  +  r2.  The  autocorrelation  function 
is  an  even  function  so  that  /?„  (0)  equal  zero.  Also  /?„(0)  =  |nP,  and  (27)  reduces  to 

+  Tj)  ~  ~(l/2)(ri  +  r2)^  Rn  (0).  (28) 


Using  the  Wiener- Khintchin-  elation  [11]  we  get 

/+00  ffl 

df 

=  V*'  /'!' (M)^Sn(/W  (29) 

where  5„(/)  represents  the  two-sided  spectral  density  of  the  n  signal  process  and  is  the 
bandwidth  (without  loss  of  generality  the  signals  are  assumed  at  baseband).  Using  (29). 
+  7*2)  can  be  upper-bounded  as  follows: 

(t,  +  r->)2  . 

An(n-hr2)  <  V.  (2rW,)W  S^iM 

2  J~w„ 

=  (30) 

On  the  other  hand,  if  the  signal  spectral  density  is  approximately  uniform  in  ('-VU^,IV'„) 
then,  Snif)  =  |nP/2W„.  Substituting  this  value  of  S„(/)  in  (29),  we  obtain 


K{t\  +  T2)  ~ 


(ri+T2)An\^  ,,2„ 


Substituting  (30)  in  (21)  we  get 


Ps/Pn> 
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and  for  the  uniform  spectral  density  signals  we  obtain 

Clearly  in  order  to  minimize  the  effect  of  the  systems’  delays  on  the  performance,  we 

1 

must  require  Ti  +  72  <<  ^  . 

27r 

Similar  argument  leads,  for  the  other  output,  to 

QJQ.  > 

for  a  signal  s(t)  having  any  form  of  spectral  density  limited  to  a  bandwidth  W,.  If  s(<)  has 
approximately  uniform  spectral  density  then 

Equations  (32)  and  (34)  might  be  written  as 


&  P./Pn  '  11  - 

'  |3|VI»I"I"P  "  +  t,))2 


i  _QJQ.  ^  Ii  -  I’cf 

MVIcPW  "  (2ir»'.(T,  +  r,))»  '  '' 

where  7p  and  7,  represent  the  input-output  improvement  in  signal-to-interference  ratio  at  P 
port  and  Q  port  respectively.  For  signals  having  uniform  spectral  density  we  have 


Tpu  — 


3|1  -fecp 

[2irW^(T^  -I-  r2)]2 


7?u  — 


3|1  -6c|2 
[2irW^,(r,+r2)p- 


As  an  example,  let  |1  —  bc\  ~  l,W^n  —  =  lOOMhz.  Then,  for  an  improvement  of 

at  least  20dB  (corresponding  to  the  40dB  signal-to-interference  ratio  at  the  output  when 
|6|  ~  |c|  =  0.1),  Ti  -1-72  must  be  less  than  0.16  nanosecond. 
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When  the  signals’  spectrad  densities  are  approximately  uniform,  then  must  be  less 

than  0.27  nanosecond.  These  values  of  delay  are  obviously  difficult  to  accomplish.  On  the 
other  hand,  if  Tj  -H  r2  ~  12  nanoseconds  (values  which  are  practically  reasonable)  then 
would  have  to  be  less  tham  1.3  MHz  or  about  2.25  MHz  if  the  signals’  spectral  densities  are 
known  to  be  approximately  uniform. 

III.  THE  POWER-CORRELATION  SCHEME 

Figure  2  depicts  the  separator  structure  termed  power-correlation.  That  is.  the  corre¬ 
sponding  separator  weights  aire  chosen  to  minimize  the  power  at  one  output  and  the  corre¬ 
lation  between  the  two  outputs.  This  section  will  follow  the  same  steps  performed  for  the 
power- power  scheme  in  the  previous  section. 

3.1  Effect  of  System  Delays  on  the  Optimal  Weights 

From  Figure  2  we  can  write 

Vp{t)  =  s{t  -  Ti) bn{t  -  Ti)  +  ;3cs(t  -  T2  -  ti/2)  +  3n{t  -  T2  -  n/2) 

+a3s{t -2t2)  +  a3bn{t -2t2).  (40) 

Using  the  definition  of  P  we  obtain  after  rearranging  terms, 

P  =  |up(t)|2  =\l  +  3{a  +  c)\'^W-2Real{3c](W-Rs{ri/2-T2))  (41) 

-2Real[a3]{W  “  -  2r2))  -  2\3\^  Real[cQ-]{W  -  RAn/2  -  r,)) 

+  l^  +  (5(1  -t-  Q6)plnP  -  2i?ea/(/^6’](ln|2  -  i?„(rx/2  -  T2)) 

-2\b\^Real[a3]{W  “  -  2r2))  -  2\3\^Real[a3]{W  -  Rn[n/2  -  T2)). 


For  Tj  =  r2  =  0  (ideal  case)  we  get 


in  agreement  with  the  result  of  [2].  However,  if  we  assume  that  |6|  and  |c|  are  much  smaller 
than  unity,  as  is  the  case  for  signal  mixtures  obtained  from  depolarization  of  dually  pol^^:ized 
signals,  amd  |q|  and  \^\  aire  constrained  to  a  vadue  which  is  very  smadl  compared  to  unity,  the 
second,  third,  and  foiurth  terms  of  the  left  hand  side  of  (41)  can  be  neglected  in  comparison 
to  the  first  term,  particulairly  if  ti  —  2r2  is  sufficiently  small,  leaving 

P  =  |l  +  «Q  +  c)|W+l‘+3(l+Q6)|"FrF-2fleo/|/36-](H5-R.(r,/2-r2)) 

-  2|6|'fleoi[Q/3|(|n|=  -  A.(r,  -  2r,))  -  2W^Real[ab\(W -  -  r,)).  (43) 

To  find  the  optimal  value  of  the  weight  0  we  equate  to  zero  the  derivative  of  the  power 
of  this  output  after  processing  by  the  discriminator;  Pi,  with  respect  to  3 


Qp  _  _  _ _  _ 

=  (a  +  c)‘<5,ils(2  -t-/3  I  Q  +  c  p  <5,i|sp  +  ^|1  +a6p(5„i|np  +  6(1  +  Q6)*(5nilrii^ 

-266ni(RP  -  i2n(ri/2  -  r^))  -  2l6|V6„i(|np  -  R^[ti  -  2t^)) 
-4/3flea/[a6]6ni(|np  -  /2n(n/2  -  rj))  (44) 

where  amd  6ni  the  effects  of  the  discriminator  on  signal  s  and  signal  n.  respectivelv. 
From  dPi  fdd  —  ^  we  obtain 


^  _  6(1  +  Q6)'6ni|nP  -I-  (g  +  c)*6,t|sp  —  266,ti(An(ri/2  —  T2))  —  2|6pa'6ni(A„(ri  -  2x2)) 

|1  +  Q6p6„i|nP  +  |q  +  cP6,i|sP  -  4i2ea/[a6]6„i(An(ri/2  -  T2)) 

6(1  +  a6)‘6nil^+  (q  +  26(1  +  2ab)'6ni{Xn{Ti/2  -  ra)) 

|1  +  a6P6„i|nP  +  |a  +  cP^^ijsP  -  4i?eaf[Q6]6„i(A„(ri/2  -  tj))  ' 

where  we  approximated  [nP  -  /2„(ri  -  2x2)  by  2(inP  -  Rn{Ti/2  -  xj)). 

For  the  Q  port  we  notice  that 


v,{t)  =  as{t  -  X2  -  xi/2)  +  abn{t  -  Xj  -  Xi/2)  +  cs(t  -  n)  +  n(f  -  xj)  (46) 
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and 


Q  =  |t;,(t)12  =  \q-\-c\^\s\^ -2Real[ac\Xi{Txl2-T2) 

+11  +  ab\‘^\^-2Real[ab]K{Tj2  -  t^).  (47) 

When  Ti  =  T2  =  0  (ideal  case)  then 

g  =  (a  +  cpi7p+|l+a6pH2  (48) 

is  in  agreement  with  the  results  in  [2j.  However,  under  the  regular  smallness  condition 
assumed  previously,  we  can  neglect  the  last  term  in  (47),  particularly  if  ti/2  —  T2  is  sufficiently 
small,  leaving 

Q=\a  +  cl'ITp  -  2i2ea/(ac-]A.(r,/2  -  rj)  +  |1  +  061^^2  (49) 

Also,  from  Figure  2 

<?!  =  |%(<K(i)f  =  Ml'  (50) 

contains  the  effect  of  the  discriminator  at  output  2. 

Where  using  (40)  and  (46)  we  find  in  Appendix  A-4,  (P-12): 

A  =  (q  +  c)<5,2|5P  -  a^,2-^s(n/2  -  r2)  +  ii*|Q  +  c|^^52^s(ti/2  -  rj) 

+2jl3'’  Im[ccc’]S32XsiTi/2  —  T2)  +  /^‘|1  +  q6P^„2^(Ti/2  —  r2) 
+2;73*/„»[a6]^n2An(i'i/2  -  T2)  +  6*(1  +  Q6)(5„2|np 

-a|6|^^„2An(ri/2  -  r2).  (51) 

Close  to  the  optimal  solution,  a  =  — c.  it  is  plausible  to  assume  that  Real[^\Q  +  c|-2]  « 
Real[{a  +  c)]  and  lTnag[0\a  +  c|2]  <<  lTnag[{a  +  c)].  Therefore  we  can  neglect  the  third 
term  of  (51)  in  comparison  to  the  first.  Also  since  Ti/2  —  T2  is  assumed  to  be  very  small, 
then  one  can  neglect  the  l«ist  term  of  (51)  in  comparison  to  its  preceding  term,  leaving 

A  =  (a  +  c)<5,2l5P-a5,2A,(Ti/2-r2)  +  2j^''/„i^,2(Q’C*]A,(Ti/2-r2) 

+l3’\l  +  ab\'^6n2Rn{Tl/2  -  T2)  +  2ji3’Im[Qb]6r,2Xn(Tl  -  2T2) 

+6'(1  +  a6)(5„2|n|2.  (52) 
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Equating  A  =  0  gives  us  the  optimal  value 

Oop-  2;  c- (1 +q6)(6  +  /3(1 +a6))’6„2|n|2/(5,2|5|2 

-2j/3-/„»[ac-]5„2A,(r,/2  -  r2)/<5,2lIF 

-2j/3-/„»(a6l42An(n/2  -  (53) 


where  we  used  |nP  ~  Fin{Txl2  —  rj)  and  |s|^  ~  /?,(ri/2  —  r2). 

We  notice  from  (45)  and  (53)  that  0op  <uid  otop  depend  on  ri/2  —  T2.  To  examine  this 
dependency,  we  define, 


/^op 

Clop 


00  +  Cl 

1  +  a6 
ClQ  +  ^2 


(54) 


(55) 


where  iSq  and  ao  are  the  corresponding  optimal  weights  when  Ti/2  —  T2  =  0.  It  can  be  shown, 
using  (45)  and  (53)  that  in  this  case  0o  =  -6/(H-a6)  and  ao  =  -c.  and  a  perfect  cancelation 
of  interferences  is  obtained. 

As  in  the  case  of  the  power-power  canceler,  by  using  (54)  and  (55)  we  get  a  set  of 
nonlinear  equations  which  czm  be  linezurized  by  neglecting  the  second  order  terms  in  ci  and 
€2-  In  Appendix  (A-5),  we  present  the  arguments  and  the  analytic  steps  used  to  derive  this 
linear  set  of  equations.  The  solution  of  this  linearized  set  is  further  simplified  by  using  the 
regular  smallness  condition  on  |6|  and  jcj  to  obtain  (see  (P-20)  and  (P-21)) 

26(1  -  6c)*6,2  -  2;7m[c6]6,i(6„2/6ni)) 

''  (l-6c)-((>/«,i)|n|VA,(r,/2-r.) 


C  =  2jImlcbjSnl  +  26’(1  -  6c)6nl  ...J.. 

^  (I -6c)-(p/<5„2)|s|VA„(ri/2- r2) 

where  6ni  and  =  1,2  represent  the  effect  of  the  discriminator  networks  {p  is  assumed 

non-zero).  Notice  that  if  Ti/2  =  r2,  A„(ri/2  -  T2)  =  0,  then  ci  =  0  and  €2  =  0  is  the  unique 

^In  fact  there  might  be  other  conditions  other  than  4  =  0  which  lead  to  minimizing  Qo  of  (50).  However 
if  the  delay  are  sufficiently  small  then  applying  the  arguments  in  [2j  we  showed  that  if  certain  smallness 
conditions  apply  then,  4  =  0  is  the  only  condition  that  implies  minimum  Q2- 
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solution.  This  corresponds  to  the  ideal,  perfect  cancelation  case. 


3.2  Effect  of  System  Delays  on  Outputs’  Powers  and  Ratios 

To  find  the  effect  of  the  system  delay  on  the  power  outputs  and  the  outputs  ratio  and 
hence  on  the  depth  of  cancelation,  we  first  notice  using  (43)  together  with  (54)  and  (55), 
that 

2 

jsP  ~  [sP  (58) 

and 


1  —  6c  +  £iC2 


1  —  6c  +  6€2 


Pn  =  |6+5(l+a6)P|n|2-2i2ea/{/J6*l(ln|2-/?„(n/2-r2)) 

-2|6(^/?ea/[Qt/?](ln|2  -  /2„(rx  -  2t2))  -  2|/?|'^^ea/[a6]( |n(*  -  /?„(ri/2  -  r^)). 

Applying  (P-22)  of  Appendix  (A-6)  we  get 

=  |6  +  3(l  +  a6)|^Wp  +  2|/J|“(W- A.(n/2-T,)) 

-2fle<.i[/}-e,|(H5  -  ft.(r,/2  -  r,))  -  2|6pBeo([Qj|(|n|"  -  -  2t,)).  (59) 

It  is  clear  that  because  \f3\  ^  16|  then  \b\^Real[a0]  <  |6|lQ||,d|^.  Therefore  if  jeij  <<  |^|  then 
Real[^’ei]  <<  |/3|^  the  third  and  fourth  terms  of  (59)  might  be  neglected  in  comparison  to 
the  second  term  leaving 

P^  =  \b+^{1+  a6)l2i;7F  -h  2\I3\^X^{t,/2  -  r, ).  (60) 


Using  6  -f-  J(1  -f  ab)  =  ci,  and  (56)  we  end  up  with 


Pn  = 

where  we  defined 


2b(l  -  bcr6,2-2jl^[cb]{6r,2/5nl) 


|l-6c|2(p/6n,)|n|VA; 


nP  + 


2161-  ^ 


klV-V, 


n  - 


(61) 


a;  =  Xnirx/2  -  1-2)  =  ln|2  -  R,{n/2  -  r2) 


and  used  ~  |6p. 
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In  the  interest  of  brevity  we  sometimes  do  as  we  did  in  (61),  drop  the  dependence  of  the 
An(T"i/2  —  Tj)  and  A,(ri/2  —  r^)  on  the  delay  rj/2  —  r2.  However,  to  distinguish  these  A's 
from  the  previously  defined  ones,  we  use  primes.  Notice  that  the  first  term  of  (61)  depends 
inversely  on  [|nP/AJ,  ^  while  the  second  depends  inversely  on  lnP/A(,.  But  A(,  depends  on 
ri/2  —  r2  so  that  ln(*/AJ,  can  easily  be  made  very  large.  From  the  discussion  in  Appendix 
(A-7)  we  conclude  that  for  lnp/A|,  moderately  greater  than  unity  (>  1.41),  (61)  is  dominated 
by  the  second  term. 

Therefore  s-signal  to  the  n-signal  power  ratio  is  given  by 


p./p,  =  "'"‘(MlVInP) 


When  |sP/|nP  2;  1,  then 


{PslPn)dB  =  (lraP/'^n(n/2  -  T2))dB  -  ^dB  -  (63) 


That  is,  the  input-output  improvement  in  s-signal  to  the  n-signal  is  upperbounded  by 
10log(l/2)RP/A„(n/2-r2). 

For  the  other  port  we  have  from  (49)  together  with  (55) 


~  |1  -  6cnn|2  (64) 

and 

Q,  =  |q  -I-  c|^|sp  -  2i2ea/(ac']A,(ri/2  -  T2) 

~  ja -)-c|^|sP +  2lc|^A,(ri/2  -  r2)  (65) 

where  we  used  i?ea/[QC*]  =  —  |cp-|-/2ca/[c*c2]  ~  —  |cp  (see  similar  argument  used  in  obtaining 
(19)  in  Appendix  (A-2).  But  by  (55),  q  -f-  c  =  €2  and  together  with  (57)  we  write 


^  2jl„,[cb]6r,,+2b'{l  -  6c)<5ni  ,  2lcp  _ 
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where  we  defined 


a;  =  A.(ri/2  -  r,)  =  |.p  -  /l,(n/2  -  r,).  (67) 

From  the  discussion  in  Appendix  (A-8)  we  conclude  that  for  almost  all  (66)  is 

dominated  by  its  second  term.  Therefore  the  n-signal  to  the  s-signal  power  ratio  is  given  by 

R2/A,(ri/2-T2),^.^^ 


Qn/Qs  = 


2|c| 


■i\n\v\sn 


When  lnP/|aP  ~  1,  then 

{QnlQs)dB  =  (1-sP/A,(ti/2  -  T2))dB  “  ^dB  “  \c\\b- 


(68) 


(69) 


That  is,  the  input-output  improvement  in  the  n-signal  to  the  s-signal  is  upperbounded  by 
10log(l/2)lsP/A,(ri/2  -  t^). 


3.3  Bandwidth  Limitation 

By  comparing  (22)  and  (26)  to  (63)  and  (69)  we  conclude  that  despite  the  difference  in 
hardware  implementation  between  the  power-power  and  power-correlation  scheme,  a  similar 
relation  governs  the  effect  of  the  delays  on  the  output  power  ratio.  Nevertheless,  while  the 
first  scheme  depends  on  A(ri  -I-  rj)  the  second  depend  on  A(ri/2  —  T2).  Similar  calculations 
which  lead  to  (32)  and  (34)  gives,  for  this  case. 


1 


W^2i^W„{n/2-T2y 

Qn/Qs  > 


(70) 

(H) 


\c\^^2TW,{n/2-T2) 

where  and  W,  are  defined  as  before.  Equation  (70)  and  (71)  represent  a  lower  bound 
on  the  performance  for  amy  kind  of  signals’  spectra.  For  the  uniform  signals'  spectra  we  get 
(see  (33)  and  (35)), 


[P.IPn).  ^ 

W^2TW^(ni2  -  '''"1  ' 

(72) 

{QnlQs)u  — 

|cP^2xW,(ri/2-r2)^ 

(73) 

45 


As  an  example,  let  =  100M//r.  Then  for  an  improvement  of  at  least  20dB, 

ri/2  —  Ti  must  be  less  than  0.16  nanoseconds.  In  practice,  we  can  take  rj  ~  rj  =  6  nanosec¬ 
ond.  If  we  can  adjust  the  difference  to  5%  of  each  delay  (0.03  nanosecond)  then  we  can 
obtain  at  least  a  20dB  improvement  for  as  much  as  a  500MHz  bandwidth,  or  better  than  a 
34dB  improvement  (corresponding  to  a  54  dB  signal  to  interface  ratio  at  the  output  when 
|6|  ~  |c|  =  0.1)  a  for  lOOMHz  bandwidth. 

IV.  THE  CORRELATION-CORRELATION  SCHEME 

Figure  3  presents  the  separator  structure  termed  correlation-correlation.  That  is.  one 
separator  weight  is  selected  to  minimize  the  correlation  between  one  output  after  it  is  pro¬ 
cessed  through  a  discriminator  network  and  the  other  output  and  vice  versa  for  controlling 
the  other  weight.  In  this  section  we  will  follow  the  same  steps  used  for  the  other  structures. 

4.1  Effect  of  System  Delays  on  the  Optimal  Weights 

From  Figure  3,  we  can  write, 

Up(t)  =:  s{t  -  Ti)  +  bn(t  -  Ti)  +  ,3cs{t  -T2-  T2I2)  -f-  3n{t  -  T2  -  ri/2).  (T4) 

Therefore, 

P  =  |up(0l^  =  1^  +  -  2^ea/[.i6’]A„(ri/2  -  rj) 

+  |1  -I-  /?cp|sp  -  2Real[3c]\s{Ti/2  -  ro)  (75) 

where  A,(r)  =  |sP  -  /2,(r)  and  A„(r)  =  |nP  -  lin(T). 


When  Ti  =  Ta  =  0  (ideal  c«ise)  then 


in  agreement  with  the  results  in  [2]. 
Also  from  Figure  3,  we  have 


Vg(t)  =  n(t  -  Ti)  +  cs(t  -  Ti)  +  abn(t  -  -  ri/2)  +  as(t  -  T2  -  ri/2)  (77) 

so  that 

Q  =  |u,(01^  =  Ic  +  aplsP +2i?ca/[Qc’]A,(ri/2  -  Tj) 

+  ll+a6pH2-2i?ea/[Q6)An(ri/2-r2).  (78) 

Th^  control  loops  operate  on  the  correlators’  outputs  Pi  and  Q2  respectively, 

as  shown  in  Figure  3, 

Pi=^Ki{t)v;{tW  =  \Ai\^  (79) 

where  one  can  easily  show  that 

Ai  =  (c  + q)'(1  +  c/?)5,ijsP  -  (q*  +  i(c(^)A,(ri/2  -  r2)«J,i 

+{b  +  3){l  +  Q6)‘6„iln|2  -  (3  +  Q*I6|^)An(ri/2  -  (80) 

with  6„i  =  nin*/|n|2  and  6,1  =  5is"/|sp.  ni  and  Sj  reflect  the  effect  of  the  discriminator 
on  output  1. 

Similarly 

Q2  =  Mi)v;(t)]^  =  (81) 

with 

A2  =  (6+/3)*(l+a6)6„2RF-(,?-  +  a|6nAn(r,/2-r2)6„2 

+(c  +  q)(1  +  c3)'8s2\s\^  -  (q  +  J*|cp)A,(ri/2  -  r2)S,2  (82) 

and  6,2  =  S2S*/lsP  and  6„2  =  n2n‘ /\n\‘^.  n2  and  S2  reflect  the  effect  of  the  discriminator  on 
output  2. 


To  find  i3op  we  must  equate  dPijd^R  and  dPijd0i,  simultaneously  to  zero.  Again  follow¬ 
ing  the  same  arguments  used  in  [2],  amd  provided  the  delays  are  sufficiently  small,  one  can 
show  that  dPild0R  =  0  and  dPxjd^i  =  0  if  and  only  if  Ax  =  0.  similarly  is  obtained  by 
equating  A2  to  zero.  From  =  0  we  get 

^  6(1  abrSnxl^  -  a’|6|"An(rt/2  -  T2)S^x  +  (c  +  -  a’Kirx/2  -  T2)6,x 


/?op  =  -- 


(1  -h  a6)-6„x|n|2  -  A„(rx/2  -  T^)Snx  +  c(c  -f  -  |c|2A,(rx/2  -  r,)S,x 


From  .42  =  0  we  obtain 

c(l  +  c.J)-6,2R^  -  /j*|cpA,(ri/2  -  t^)8,2  +  (6  +  -  i‘An(r,/2  -  T2)Sr,2 

~  (1  +  c/3)-«,2R2  -  A,(t,/2  -  T,)S,i  +  6(6  +  /J)-<,2|nP  -  |6pA„(r,/2  - 


To  find  the  effect  of  delay  ri/2  —  T2  on  the  optimal  weights  we  define 

dop  =  /?o  +  Cl  (S5) 

Q!op  =  Q!o  +  C2  (86) 

where  Jo  =  and  Oo  =  — c  are  the  optimal  weights  when  tx/2  —  72  =  0. 

.Again,  by  using  (85)  and  (86)  in  (83)  and  (84)  we  get  two  nonlinear  equations  in  ci  and 

C2.  These  can  be  linearized  by  neglecting  second  order  terms  in  ci  and  €2-  The  resulted  set 

of  linear  equation  is  then  solved  (see  Appendix  A-9)  to  finally  obtain 

^  -JlO  +  fee)- 

'  (l-c6)-|n|VA.(T,/2-r2) 


— c(l-|-6c)’ 

"  (l-c6)-p|IP/A,(ri/2-r2) 

Notice  that  if  tx  =  72  then  cx  and  C2  are  zero  and  we  have  the  ideal  perfect  cancelation  case. 


4.2  Effect  of  System  Delays  on  Outputs’  Powers  and  Ratios 

To  estimate  the  effect  of  the  system  delay  on  the  power  outputs  and  the  outputs  ratio 


we  first  notice,  using  (75),  that 


P,  ~|H-,JcHs| 
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where  the  last  term  in  (75)  was  neglected  due  to  the  fact  that  \c\  is  assumed  less  than  unity. 
\j3\  is  restricted  to  less  than  unity,  and,  particularly,  for  ri/2  —  T2  small,  A,(ri/2  —  T-i)  is  small 
in  comparison  to  |sP.  Using  (85)  with  A)  =  (89)  becomes 

P,  =  |1 -5c  +  c«ins|2 

~  jl  -  6cpIIi2.  (90) 


.Also  from  (75)  by  using  (P-9), 


=  |6-f-^|VP-2i?ea/[^6-]A„(n/2-r2) 
-  |6-H,dpRP  +  2|6p(A„(ri/2-r2)). 


But  h->r  3  =  cind  together  with  (87) 


P  =  +  _  V|_  _ j 

"  (l-6c)1n|VAn(n/2-r2)  |n|VAn(r,/2  -  r2) 


It  is  easy  to  notice  that  if  \bc\  «  1  then  (92)  is  dominated  by  its  second  term.  Therefore, 
the  s-signal  to  the  n-signal  ratio  is  given  by 

D/D  P  ~  ^cp|nP/An(ri/2  - 


PjPn 


Notice  that  this  is  exactly  (21)  obtained  for  the  power-power  scheme,  except  for  the  depen¬ 
dence  of  An  on  ti/2  -  T2  instead  of  on  n  +  T2.  Comparing  it  with  (62)  obtained  for  the 
power-correlation,  we  notice  the  small  difference  due  to  the  inclusion  of  |1  -  6cp  ~  1  in  (93). 
Both  in  (62)  and  (93),  A„  depends  on  ri/2  -  T2.  Because  of  the  symmetry  we  get  by  using 
(78)  and  implying  similar  steps  and  arguments; 

Qn  |1-MW  (94) 

^  c(l-l-6c)’  ,  2lcp  ^ 

Q.  ~  - == -  5 r -h  = - Ur  (9d) 

(l-6c)-|3P/A,(r,/2-r,)  |s|VA.(r,/2  -  r,) '  ' 
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Equation  (96)  is  exactly  the  same  as  (25)  obtained  for  the  power-power  scheme  except  for 
the  dependence  of  A„.  It  differs  slightly  from  (68)  obtained  for  the  power-correlation  '(  heme. 

3.4  Bandwidth  Limitation 

Disregtirding  the  small  differences  between  (93)  or  (96)  and  (62)  or  (68)  respectively  ( [I— 6c|  ~ 
1),  then  (70)  and  (71)  axe  lower  bound  limits  on  the  output  signal-to-interference  ratio.  In 
the  Ccise  when  the  signals’  spectra  can  be  approximated  by  uniform  spectra  limited  to  band- 
widths,  and  Wj  for  the  n-signal  amd  s-signal  respectively,  then  (72)  and  (73)  obtained  for 
the  power-correlation  scheme  are  also  in  effect  for  the  correlation-correlation  case.  Therefore 
the  numerical  examples  used  there  are  also  valid  for  the  correlation-correlation  scheme. 

V,  SUMMARY  OF  RESULTS  AND  CONCLUSION 

In  this  section  the  different  results  obtained  in  this  paper  are  summarized.  These  are  as 
follows: 

1.  The  optimal  weights  i3op  and  Qop  of  the  three  schemes  with  delays  rj  and  t2  are  shown 
in  Table  lA. 

2.  The  corresponding  zero  delay  optimal  weights  3o  and  qq  are  given  in  Table  IB. 

3.  The  effect  of  circuits  delays  on  the  optimal  weights  (Table  2)  are  represented  through 

=  3op  —  3o  and  €2  =  Qop  —  Qo,  except  for  the  power-correlation  scheme  where 

Cl  =  (1  -f  ab){(3op  —  l3o)- 

4.  The  effect  of  circuits  delays  on  the  output  power  ratios  are  shown  in  Table  3. 

5.  Input-output  improvement  in  signal-to  interference  power  ratios  are  shown  in  Table  4. 

6.  Output  power  ratios  as  a  function  of  signals’  bandwidths  and  circuits  delay  are  shown 
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in  Table  5.  For  the  case  when  the  signals’  spectral  densities  are  assumed  uniform,  then 
the  output  power  ratios  are  5dB  above  the  lower  bound  values  shown  in  Table  5. 

The  effects  of  nonzero  hardware  delays  on  the  performance  of  the  three  different  cross-pol 
cancelers  were  examined  in  this  paper.  Firstly,  the  effects  of  these  delays  on  the  optimal 
weights  were  considered  and  the  variations  from  the  ideal  zero  delay  case  were  obtained. 
Secondly,  the  output  powers  and  power  ratios  at  each  of  the  canceler  ports  were  exhibited 
as  a  function  of  the  actual  circuit  delays.  Depending  on  the  different  configuration,  differ¬ 
ent  forms  of  dependence  resulted.  In  particular,  we  notice  that  while  in  the  power-power 
scheme  the  performance  depends  inversely  on  Ti  +  T2,  where  Tj  and  rj  are  delays  of  the 
summation  and  cancelation  paths  respectively,  the  performances  of  the  power-correlation 
and  correlation-correlation  schemes  depend  inversely  on  ri/2  —  rj.  Finally,  using  the  relation 
between  the  signals'  autocorrelation  and  spectral  density  we  could  estimate  the  lower  bound 
on  the  depth  of  cancelation  as  a  function  of  both  the  signals’  bandwidths  and  system  de¬ 
lays  and  hence  establish  bandwidth  limitation  due  to  system  delays.  For  the  case  when  the 
signals’  spectra  are  approximately  uniform  and  limited  to  Wn  and  VV^,  respectively  for  the  n 
signal  and  the  s  signal,  we  shew  the  output  signal-to-interference  ratio  as  a  function  of  these 
bandwidths,  the  system  delays,  the  input  power  ratio  and  the  input  cross-pol  ratios.  Using 
the  power- power  scheme,  the  output  signal-to-interference  ratio  depends  inversely  on  Tj  f  r,, 
for  the  other  two  schemes  it  depends  inversely  on  ti/2  —  rj.  Since  this  delay  difference  can  be 
made  very  small,  these  cancelers  are  preferable  and  yield  good  cancelation  over  a  much  wider 
signal  bandwidths.  The  relative  delay  difference  ri/2  —  can  be  held  to  under  0.3  ns  for 
values  of  Ti  and  T2  6nsec  (<is  one  may  expect  for  a  typical  14-18  GHz  microwave  circuitry). 
Using  these  values  in  the  design  of  a  power-correlation  or  correlation-correlation  systems, 
one  can  obtain  as  much  as  20dB  input-output  improvement  in  signal-to-interference  ratio 
(corresponding  to  40dB  signal-to-interference  ratio  at  the  output  when  input  cross-pol  ratio 
|6|  ~  jc]  ~  0.1  or  20dB)  when  the  signals’  bandwidth  are  of  the  order  of  500MHz.  On  the 
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other  hand,  with  the  same  assumption  on  accuracy  of  the  delay  timing  we  can  achieve  almost 
34dB  improvement  (54dB  output  signal-to-interference  ratio),  if  the  signal  bandwidths  are 
only  lOOMHz.  Similar  examples  show  that  the  power-power  scheme  can  handle  only  a  small 
bandwidth  if  ti  =  rj  is  of  the  order  of  6  nanoseconds.  However,  the  power-power  scheme 
might  be  applied  with  reasonable  success  in  lower  frequency  low  bandwidth  application.  For 
example,  if  the  frequency  band  is  in  the  4-6  GHz  range  then  t\  and  T2  are  of  the  order  of 
1  ns,  so  that  20dB  input-output  improvement  in  signal-to-interference  can  be  accomplished 
with  approximately  8  MHz.  If  the  cancelation  is  performed  in  the  TO  MHz  IF  frequency 
then  the  x/4  wavelength  delay  needed  for  the  in-phase-quadrature  weighting  will  restrict  the 
delay  r  to  greater  than  3.5  ns.  If  we  assume  ti  =  T2  =  5ns  the  bandwidth  will  be  limited  to 
approximately  2MHz.  Notice,  however,  that  the  power-power  scheme  requires  much  simpler 
hardware  than  the  other  two  schemes,  so  that  the  hardware  complexity  bandwidth  trade-off 
is  exhibited. 
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Vni.  APPENDICES 


A-1 

Substituting  (13)  in  (8)  and  (14)  in  (12)  we  obtain,  respectively; 

^  ~(1  -  c6)|sPe;6,i  -I-  6(1  +  &c  -  6e2)'An(ri  +  r2)^ni  (P  -  1) 

c6,i|sPc;  +  (1  -  c6  +  6e2)*'6„i|n|2  -  6-(c2  -  c)*A„(ti  +  r2)<5„i 

and 

^  -(1  -  C&)|nPe;6n2  +  b{l+bc-  6€i)‘A,(Ti  -I-  T2)6s2  {?-•>) 

W„2|nj2eJ  +  (1  -  c6  +  6€i)*5n2|5p  -  C-(€i  -  6)*A,(ri  +  T2)6s2 

These  two  equations  can  be  linearized  by  neglecting  the  second  order  terms  that  contain  cic] 
and  namely; 

[(1  -  cbySnl\n\^  +  6V6niAn(Tj  +  r2)]£i  +  [(1  -  c6)^,i|s|2  +  6niK{Ti  +  T2)]c2 

=  6(1  +  6c)*6niAn(ri  +  T2)  (P-3) 

([(1  -  c6)‘6,2laP  +  6’‘c’6,2A,(ri  -|-  r2))c2  +  [(1  -  c6)^„2ln|2  -|-  |cp6,2A,(ri  r2)]ej 

=  c(l  -I-  6c)*6,2A,(ri  -h  72 ).  (P-4) 

(P-3)  and  (P-4)  also  contain  the  effect  of  the  two  discriminator  networks  6ni,6ji,(5„2  and  (5,2- 
For  simplicity  of  notation,  we  sometimes  use  |ni  |  ^  =  <5ni|n|Mn2|2  =  6n2|n|Ms,|2  = 
and  IS2P  =  6,2|sP.  Equations  (P-3)  and  (P-4)  can  be  written  as 

(1  -  c6)*|ni|2  +  6“c*6„iA„(ri  -I-  72)  (1  -  c6)|si|2  -1-  |6p(5niA„(7i  -f-  72)  ' 

.  (1  -  c^)''h2p  +  |c|^<5,2A,(7i -h  72)  (1  -  c6)|s2p -H  6c<5,2A,(7i -h  72) 

’  ei  1  r  6(1  +  6c)*6„iA„(7i  -I-  72)  ■ 

X  =  .  (P-5) 

.  cj  J  L  c*(l  +  6c)6,2A5(7i  -I-  72) 

If  |6|  <<  1  and  7i  -t-  72  is  small  enough  then  it  is  reasonable  to  assume  that 

|6|^6„iA„(7i -+-72)  <<  i2ea/(l  —  c6)|sip.  Similar  argument  implies  that  |cp6,2(A5(7i -1-72))  << 


Real(l  —  c6)‘|n2P.  Also  A„(ti  +  t^)  <<  [nP,  and  A,(ri  +  tj)  <<  |sP  so  that  the  second 
te  rns  in  all  the  matrix  elements  can  be  neglected.  Thus  (P-5)  becomes 


(l-c6)*|niP  (l-cfr)lsiP'  ■  6, 

(l-c6)-|n2P  (1-c6)|s2P.  .  ej 


6(1  -I-  6c)'6„iA„(ri  -f  rj) 
c*(l  6c)652Aj(tj  -f  tt  ) 


(P-6) 


The  solution  of  (P-6)  is  given  by 

^  _  6(1  +  bc)’6nl  -  C*(l  +  bc)Ssl(\,{Ti  +  T2)/Xn{Tl  +  T2 ) ) 

’  (1  -  c6)*(p/6,2)|nP/An(ri -H  Tj) 

^  _  c(l  -t-  bc)’6,2  -  6'(1  -t-  6c)6n2(An(ri  +  r2)/A,(Ti  +  72)) 

^  (1  -  c6)*(p/6„,)jsP/A,(T,  +  rj) 

where 

P  =  ^»2^nl  —  <5,1 6n2 
A,(n-fr2)  =  |sp  -  ^,(ri  +  Tj) 

An(n+T2)  =  |nP  - /?„(r, -I- Tj). 


By  definition  of  j3, 

/^6*  =  -|6p-He,6- 

and  using  (P-7) 

|6|^(l-f6c)-6„i  -(|6c|^-h_^-)6,i(A,/A^) 

(1  -  c6)'(/>/6,2)|np/A„ 

-(1  -  c6)-|6p(/>/6,2)WA„  -^  |6|^(1  6cr6ni  -  (|6cp  -^  6V)6,i(  A,/A„ ) 

_  (1  -  c6)*(p/6,2)|nP/A„i 

-|6p((p/6.2)M^/An  -  6ni  +  |cp6,i(A,/An))  -)•  c-6-a^^(p/6,2)WAn  -)-  |6p6ni  -  6,i(A,/A„)) 

(1  -  c6)*(/?/<5,2)|np/A„i 


fib-  = 
-(6p  +  €i6*  = 
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For  simplicity  of  notation,  we  dropped  the  argument  of  A„  and  A,.  If  ti  +  rj  is  sufficiently 
small  so  that  |nP/A„  >>  1  then  we  can  assume  l|cp6,i(A,/A„)  —  ^nil  <<  and 

|6p^nl  «  mp/6s2)W/K. 

Therefore, 


Because  |nP/A„  >>  1  we  conclude  that. 


b’cS.iXJK 


(1  -  cfe)-(p/6,2)|nP/A„ 


Real[0b-]  ~  Real[-\b\^  +  e^b]  ~  -|6|^ 


(P-9) 


A-3 


To  compare  the  magnitudes  of  the  two  terms  in  (20),  we  notice  that  both  terms  are 
monotonically  decreasing  with  lnP/A„.  For  |n|^/An  very  large  the  second  term  is  larger  than 
the  first.  Cross  over  occurs  (i.e.,  the  value  for  lnP/A„  below  which  the  second  term  becomes 
smaller  than  the  first)  for 


j— _  |6(1  4-  bcySni  —  c‘(l  -i-  6c)6,i(A,/ Xn)\^ 
|1-c6|2(p/<5,2)22|6|2 


(P-10) 


By  its  definition  |nP/A„  >  1.  Equality  occurs  only  when  rj  or  T2  is  sufficiently  large.  For 
Ti  =  Tj  =  0  |nP/An  — ►  oo.  It  is  easy  to  show  that  if 

|1  +  6c|(|6|^„i  +  |c|5,i(A,/AJ) 


<  1.41|6| 


(P  -  ii; 


|1  -cb\ip/S,2) 

then  the  right  hand  side  of  (P-10)  is  less  than  unity  so  that  for  almost  all  values  of  |n|2/A„, 
(20)  is  dominated  by  the  second  term.  Since  (5„i  <  <5,1  ~  1,A,2/A„i  ~  1  ~  1  and  |6|  ~ 

|cl  <<  1,  then  (P-11)  is  e£isily  satisfied. 
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A-4 

From  (50) 

A  =  u„(i)u;(0 

and  using  (40)  and  (46)  we  obtain  after  some  manipulation. 

A  =  (a  +  c)6j2|s|^  —  q6j2('^*(''‘i/2  —  ^2))  4- +  c|^6,2i2»(7'i/2  —  Tj) 

+0-ctc6,2iK{n/2  -  r^))  ~  3-caS,2{Rs(nl2  -  t^)  -  i?,(r,  -  2r2)) 

+3‘\l  +  Qb\Hr,2Rn{Tl/2  -  T2)  +  3’abSr,2(W  "  «n(ri/2  -  Tj ) ) 

-3-cc-b'Sn2{Rn(Til2  -  T2)  -  R^in  -  2r2)) 

+6*(1  +  a6)6„2RF  -  a|6p6„2(pF  "  Rn(n/2  -  rj)). 

Combining  terms  and  using  the  approximation  \n\'^  —  Rn{Ti/ 2  — T2)  ^  Rn{T\l2  —  T2)  —  Rn[T\  — 
2T2)  and  js]2  -  i2,(ri/2  -  T2)  2;  i2,(ri/2  -  T2)  -  RAn  -  21*2)  we  obtain. 

.4  2;  (q  +  0)^,2151^  —  Q!^*2(-^»(ti/2  —  r2))  +  i*|a  +  cp(5,2/?5(Ti/2  —  r2) 
+2;73'/^[QC*]6,2(A,(rx/2  -  rj))  +  3‘\l  +  ab\-6r,2(Rn(Ti/2  -  rj) 

+2;/i-/„»[Q6]6„2(An(ri/2  -  T2))  +  b'{\+  q6)6„2H^ 

-a|6|2^„2(An(ri/2-r2)).  (P-12) 

A-5 

Using  (54)  in  (53)  we  obtain, 

(  1  +  Q6)"652|5Pe2  =  ~(  |1  +  +  I’s  +  t’n  +  M  +  ^'’n)  (  P  —  13) 

where 

V,  =  2jIm[Qc]6,2{XATl/2  -  T2)) 

and 

Vn  =  2j7m[a6]<5„2(A„(T,/2  -  72)). 

By  using  (55)  and  rearranging  term,  (P-13)  becomes 
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(1  +  a5)-5.jH2e2  -  2j5V„[c2C*]5.2(A,(ri/2  -  r2))  -  2;6-/«[c26|^„2(A„(n/2  -  t^,)) 

+{|1  +  a6p5n2R^  +  2j7„»[c2C-]5,2(A.(n/2  -  72))  -  2j7^[(-c  +  C2)6l6„2(A„(ri/2  -  72))}^ 
=  -2j7„[c6]MAn(ri/2  -  r2)).  (P-14) 

Since  A,(ri/2  —  r2)  and  An(ri/2  —  r2)  is  much  smaller  than  js^,  it’s  reasonable  to  assume 
that  both  the  real  and  imaginary  parts  of  the  second  and  third  term  of  (P-14)  are  much 
smaller  than  the  corresponding  parts  of  the  first  term.  Neglecting  these  terms  as  well  the 
second  order  term  in  Ci  and  C2  we  get; 

(1  -  6c)*^,2M1^C2  +  {|1  -  6ci^6n2ln|2  +  2j7„,[c6)6„2An(ri/2  -  r2)}c; 

=  -2j  Im [c6)6n2 A„ ( Ti  /2  -  r2  ) .  (P-15) 

Using  (45)  and  recognizing  that  e  b  +  +  ab)  we  get  after  some  manipulation 

-  ~(^  -  6c)(q:  •fc)*^,2|^P +  26(1  +a*fe'’  +  2|a6p)6n2An(Ti/2-  r2) 

^  |1  -b  a6p5„2|nP  +  |a  -b  c|2|s|2  -  AReal[ab]6n2KiTi/2  -  T2) 

By  neglecting  21a6|^  at  the  numerator,  using  a  +  c  =  €2  and  neglecting  the  second  order 
terms  in  Ci  and  €2  we  obtain 

jl -6c|2^nilnPei  +  [(l-6c)lsl2-2l6|^5niAn(Ti/2-r2)]e; 

=  26(l-6c)*6„,A„(ri/2-r2).  (P-16) 


Equations  (P-15)  and  (P-16)  are  a  set  of  linear  equations  in  ei  and  €2,  which  can  be  written 
in  matrix  form; 

•  11  -  cb\Hr.lW  (1  -  cb)8,^W  -  2l^^nlAn(n/2  -  r2)  j  f  C;  ' 

.  |1  -  cb\H^2W  -  2jIm[cb%2K{n/2  -  T2)  (1  -  c6)6,2R^  J  [  . 

■  26(1  -  6c)'6niAn(ri/2  -  T2)  ' 

=  •  (P-IT) 

_2jlm  (M^nzAn  (  Tj  /2  -  T2  ) 

If  6  <<  1  and  ri/2— rz  are  sufficiently  small  then  2|6|^6niAn(Ti/2-r2)  <<  /?ea/(l— 6c)<5,i|si|^. 


With  this  in  mind  the  solution  of  (P-17)  is  given  by 
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_  (1  -  6c)[26(l  -  6c)*^,2«?ni|-sPAn(n/2  -  T2)  -  277m[c6]^»l<^n2l-SpAn(ri/2  -  r^)] 

■  (1  -  bc)\l  -  6cP(pNW)  +  2;7„[c6]I7FAn{rx/2  -  r,) 

(P-18) 

|1  -  bc\^[-.2jUcb\S^,6n2M\nin/2  -  T^)  -  2&‘(1  -  ^ /•2  -  T,)] 

^  (1  -  6c)*|l  -  6cl2(p|nP|5p)  +  2j7m[c6](S,i<S„2lsPAn(Ti/2  -  Tj) 

(P-19) 

In  obtaining  (P-19)  we  used  the  assumption  that  the  re2J  of  26(1  —  6c)*A„(ri/2  —  rj)  is  much 
smaller  than  |1  —  6cp|nP  and  the  imaginary  part  of  26(1  —  6c)"/„j[c6]A„(ri/2  —  T2)  is  much 
smaller  than  the  real  part  of  6(1  —  6c)*ll  —  6cp|np.  The  second  term  at  the  denominator  of 
(P-18)  and  (P-19)  can  easily  be  neglected  in  comparison  to  the  first  so  that  we  can  write 


26(1  -  c6)-6,2  -  ^m[c6|6,i(6n2/6nl) 

|i-c6P(W«.i)NVA.(n/2-T2) 


I  P-20) 


2jlm[cb)6„i  +  26*(  1  —  6c)6n3 
(1  -  c6P(p/6„2)|5p/An(Ti/2  -  T2)' 


(P-21) 


From  (54)  we  have 


f3  -I-  0ab  =  -6  +  ei 


=►  |/?p  +  |/?pa6  =  ,i*(-6  +  cx) 


\/3\^Real[Qb]  =  -|^p  -  f?ea/[/3*6]  +  Real[l3’ei] 
\l3\^Real[ab]  +  RealliSb’]  =  -|/3p  +  Real[f3’t^]. 


(P-221 


For  lnP/A'„  very  large  the  second  term  of  (61)  is  larger  than  the  first.  The  second  term 
becomes  smaller  than  the  first  only  if 


|2t(l  -  beys,,  -  2j7„lc61<.i(<„;/<„i) I'  ^  nr,,. 


|l-4c|=(P/«nl)l/2|»l 


(P-23) 
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Now  if 


\l-bc\\b\6,2  +  U[cb]S,l(6n2/Sni) 


<  C|61/1.41 


(P  -  24) 


|l-6cP(p/5ni)  ^  ' 

then  the  left-hand  side  of  (P-23)  is  less  than  C.  But  lnP/A'„  is  greater  thaui  unity,  (in  fact  since 

An  is  a  function  of  ri/2  —  rj;  it  can  easily  be  made  greater  than  some  constant  C).  Therefore 
if  (P-24)  is  satisfied  then  (P-23)  cannot  be  satisfied,  for  adl  A(,  such  the  |n|2/A(,  >  C,  and 
the  second  term  of  (61)  dominates  the  first.  Since  6,i  <  6,2,  p  —  1  and  16|  ~  |c|  <<  1  then 
(P-24)  is  easily  satisfied  for  C  slightly  greater  than  1.41. 


First  we  write  (66) 


^  2jUcb]Sni+2b‘{l^bc)S„,  -p: 

{l-bc)p{\UK)WIK)  klVA',' 


(P-25) 


If  the  two  signals  have  approximately  similar  statistical  properties  and  bandwidths.  then 
with  varying  the  delay,  A',/A(j  remains  approximately  constant.  Therefore,  the  first  and  sec¬ 
ond  terms  of  (P-25)  varies  inversely  proportional  to  (Isj^/A',)^  and  I^P/A'  respectively.  Thus 
applying  the  same  argument  of  A-7  the  second  term  of  (P-25)  dominates  the  first. 


Using  (85)  and  (86)  in  (83)  and  (84)  we  obtain  respectively,  after  algebraic  manipulation 

^  _  -(1  -  6c)|s|^^,i€2  -  Ml  +  be -bt2)’ Kin  12  -  T2)6ni  -  (6|cp  c*  -  e;)A,(ri/2  -  T2)6,i 

^  c|s(26,iC2  -I-  (1  -  c6  -f-  6c2)*|n|2^„i  -  Xnin/2  ~  T2)6ni  -  |c|2A,(ri/2  -  r2)6,i 


_  -(1  -  6c)|n|V  t  -  c(l  -H  6c-  cei)'A,(Ti/2  -  T2)6,2  -  (c|6p  +  b"  -  e^)Ani-»/ .  - 
^  6|n|26„2cl  +  (1  -  c6-|-  cci)*|5|2^,2  -  A,(r,/2  -  T2)6s2  -  |6|2A„(ri/2  -  T2)6,2 


By  neglecting  the  second  order  terms  that  contains  cicj  and  €2^^  we  can  reduce  these  equa¬ 
tions  to  the  following  linear  set  of  equations, 
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[(l-6crW26„i  -  A„(ri/2-r2)^„, -lcpA,(r,/2-r2)6,i]cx 

+  [(1  -  bc)W^si  -  A,(rx/2  -  72)6,1  -  |6|^\n(ri/2  -  72)]^; 

=  -6(1  +  c6)-An(7i/2  -  72)6„i  -  c-(l  +  c6)A,(7i/2  -  72)6,1 

[(l-6c)*i7F6,2  -  A,(7i/2- 72)6,2  -16l2An(7i/2-T2)6n2]e2 

+  [(1  -  6c)H^6„2  -  An(7i/2  -  72)6„2  -  1c|'A,(7i/2  -  72)6,2]^! 
=  -c(l  +  c6)*A,(7,/2  -  72)6,2  -  6*(1  +  c6)A„(7i/2  -  72)6„2 

or  in  matrix  form; 

■  ((1  -  bcYW  -  K)^ni  -  WK^sI  ((1  -  f>c)W  -  A;)^,1  -  WK^ni  1  T  ^i  ' 

.  ((1  -  bcYW  -  K)^n2  -  I^A;6,2  ((1  -  bc)W  -  K)^s2  -  WK^n2  J  [  ^5. 


-6(1  +  6c)*A;6„i  -  c*(1  +  6c)A;6,i 
-6(1  +  6c)*A;6„2  -  c*(1  +  6c)A;6,2 


(P-26) 


where  A'  stand  for  X{ti/2  -  72).  If  |c|  <<  1,  6,i  <  6ni  then  |c|^A',6,i  <<  |n|^6„i,  particularly 
if  jsP  ~  Inp  and  7i/2  —  72  is  very  small  in  comparison  to  the  signals’  correlation  time.  Also, 
7i/2  -  72  small  implies  AJj  <<  |nP.  This  leaves  (1  —  6c)*|nP6„i  and  (1  -  6c)|sp6,2  at  the 
diagonal  of  the  matrix  in  (P-26).  By  similar  argument  we  can  neglect  in  the  off-diagonal 
terms  the  A(j  and  A',  term  in  comp2irison  to  jnP  and  respectively.  Thus  (P-26)  reduces 

(1  -  6c)”|np6„i  (1  -  6c)(sp6,i  ■  '  ci 

(1  -  6c)'‘jnp6n2  (1  -  6c)|sP6,2  .  . 
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■  -6(1  +  6c)-A;6m  -  c-(l  +  6c)A;6,i  ' 
.  -6(1  +  6c)-A;6„2  -  c-(1  +  6c)A;6,2  . 


(P-27) 


whose  solution  is  given  by 

_  -6(1  -bc){l  +  6c)*|3PAn(n/2  -  T2) 

|l-c6|2|3|2|n|2 

_  -c(l  -  6c)(l  -I-  6c)‘|nPA,(ri/2  -  r^) 
|l-c6|2|5|2|n|2 


(P-28) 

(P-29) 


In  the  derivation  of  (P-28)  we  used;  p  =  6,26ni  —  6ji6n2  with  6,1  <  6,2  and  6„2  <  6ni, 
is  of  the  Same  order  as  lcplsPA'6,16,2,  c*|6|‘‘A^6ni6„2  +  c*|6|^A'„A'6'„,6, 

«  c-|6pi7FA;p,  6|c6pA;A;6„i6,2  «  6k6|WA;/)  and  6|6|2A;?6„i6„2  «  6|7pA;p.  Sim¬ 
ilar  assumptions  were  applied  in  the  derivation  of  (P-29). 
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HOWtH-POWbH 


the  (Jiiicriiiiiiiator  uii  output  I  ami  b,-i,b„2  the  bauie  elFect  on  output  '2.\„  =  |i«|^  —  H„(r)  ami  A,(r)  =  jbp  —  lt,{T)  represent  the  effect  of  circuit  delay  with  Unit)  and 
ltt{T)  are  the  autocorrelation  fiiiiclioii  of  u(t)  and  s(l)  respectively. 


TABLE  3.  Kirect  of  cirruils  delay  on  1*  port  ami  Q  port  outputs  power  ratios.  A„(t)  =  |iiP  -  am!  A,(t) 
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TABLE  5.  Output  power  ratio  as  a  function  of  singals’  bandwidth,  IT5  and  and  circuits  delay  T|, 


Figure  1.  Power-Power  Bootstrapped  Cross-Pol  Canceler. 
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APPENDIX  B 

BOOTSTRAPPED  ADAPTIVE  SEPARATION  OF  TWO 
SUPERIMPOSED  SIGNALS  - 
STABILITY  CONSIDERATIONS 

by 

Abduikadir  Ding  and  Yeheskel  Bar- Ness 
1.  INTRODUCTIONS 

In  a  previous  study  [1],  we  found  the  equilibrium  points  for  the  weights  of  the  boot¬ 
strapped  algorithm.  The  question  which  arises  is  whether  these  equilibriums  are  stable 
steady  state  points.  We  will  answer  this  question  for  the  three  schemes  of  the  bootstrapped 
algorithm,  the  power-power,  correlator-correlator  amd  power-correlator,  separately.  We  will 
restrict  our  discussion  to  the  case  of  no  noise;  that  is  the  dual  channel  noises  £{nf(n)}  and 
£’{n2(n)}  are  zero.  Also,  for  the  sake  of  simplicity,  we  will  consider  the  signal  to  be  real. 
This  is  the  case,  for  example,  when  the  transmitted  data  is  an  M-ary  signal.  From  Fig.l. 
the  channel  response  in  the  no  noise  case  is, 

Xi(n)  =  aiili(n) -h  ai2l2i^) 

i2(n)  =  021 /i(n) -I- 022/2(^1  (1) 

where  Xi(n)  and  X2(n)  are  the  sampled  received  signals  at  the  first  and  second  channels 
respectively.  /i(n)  i  =  1,2  are  the  inputs  of  the  channel,  which  are  taken  to  be  real, 
equally  likely  distributed  from  the  set  {±lc, ±3c, .... ±[y/M  -  1  )c}  and  c  is  a  constant  which 
determines  the  distance  to  the  decision  boundary  from  each  signal  location.  .Also,  we  will 
assume  in  this  study  the  channel  co-pol  and  cross-pol  responses  to  be  real,  that  is. 


denote  the  magnitude  of  the  normalized  cross- pol  interference  (XPI)  constants  of  one 
channel  onto  the  other. 


n.  EQUILIBRIUM  POINTS 
2.1  The  Power-Power  Scheme 

With  the  arrangement  of  the  power-power  cross-pol  canceler  (XPC)  of  Fig.  2,  the  canceler 
outputs,  j/i(n)  and  y2{n)  are  given  by, 

xi(n)  -|-X2(n)u7i2 


yi(n)  = 


1  —  UJi2U;2i 


X2(n) -I- ii(n)u;2i 

j/2(n)  =  - ^ - . 

1  —  W12W21 

Substituting  for  Xi(n)  and  X2(n)  from  (1),  we  get 

h{n){aii  -I-  WiiUji)  +  /2(n)(ai2  +  u;i2a22) 

y^[n)  =  - - - - - 

1  —  U;i2W21 


(3) 


(4) 


(5) 


y2in) 


/i(n)(a2i  -b  u;2iQii)  +  /2(u)(a22  +  {^21012) 
1  —  W12W21 


(6) 


For  this  scheme  the  control  algorithm  simultaneously  minimizes  the  output  powers  P  amd 
Q.  In  fact  it  simultaneously  searches  for  d£(yu(n)^}/dwi2  =  0  and 

^£{y2d(n)^}/dw2i  =  0,  where  E{-}  is  the  expected  value  and  yu,  y2d  are  the  outputs  of  the 
discriminators.  Finding  the  zero  derivatives  can  be  done  by  successive  use  of  the  following 
recursive  equations,  provided  that  1  —  W\2W2\  ^  0. 

Q 

^l2^  =  +  {■) 

Q 

(8) 

where  /xi  and  ^2  are  the  constants  which  determine  the  stability  of  convergence.  The  dis¬ 
criminators  enforce  a  chainge  in  the  powers  of  the  /i  and  I2  signals  by  where  i=1.2  refers 
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to  the  two  outputs  yi  and  yj,  respectively,  while  j=l  refers  to  signal  h  and  /j,  respectively  . 
Due  to  the  assumption  that  the  channel  responses  and  the  signals  are  real,  wi2  and  w^i  are 
also  real.  Clearly,  the  equilibrium  points  must  simultaneously  satisfy  the  following  equations 


M2 


dPiiWi2,W7l) 

dxa\2 

dQi{Wi2,W2l) 

dtV2i 


^,■^E{y^Anf]  =  0 

OWi2 

UW2\ 


where  by  using  (5)  and  (6),  we  get  the  power  at  the  output  of  the  discriminators. 


Pl{Wi2,U}2l)  = 


6ll.E{/l(n)}(aii  +  U>i2Q2i)^  +  <^12^{^2('^)}(^12  +  I^12Q22)^ 

(1  -  u;i2u;2i)^ 


Q\{W12,W2i)  = 


^21-£^{/i(^)}(Q21  +  U^2iQii)^  +  <^22£’{-^2(^)}(°22  +  U;2iai2)~ 

(1  -  Wi2W2\)^ 


(9) 

(10) 


(11) 


(12) 


Wi2opt  and  W2iopt  are  taken  to  be  the  steady  state  value  of  these  weights  from  (7)  and  (8). 
respectively.  That  is,  they  satisfy  (9)  and  (10).  Taking  the  derivative  of  (11)  and  (12)  with 
respect  to  and  u;2i  and  multiplying  with  the  convergence  constants  respectively  we  get: 


Ml 


dPijwu,  1^21 ) 
dwi2 


2mi 


•  (n)}(an  +  W\202i)(*^21  +  f^'21<^ll 


(1  -  u;i2l«2l)^ 

+  S\2E{ll{n)}{ai2  +  Wi2Cl22){<^22  +  1^21^12) 


(13) 


M2- 


dQiiwi2jJf2^ 

dW2\ 


iH2 


■'s2iE{P,{n)}{ 


(1  -  u;i2{W2i)^ 

+  ^22E  {l\{n)}{a\2  +  W\20’22){0'22  +  *^21012) 


an  +  Ii;i2a2i)(fl2i  +  it.>2iaii) 


14) 


Note  that  without  the  inclusion  of  the  discriminator  the  two  equations  in  (13)  and  (14)  are 
dependent.  If  the  discriminator  is  chosen  such  that  6ii<522  ^  ^21^12  then  (13)  and  (14)  are 
independent.  These  solutions  determine  the  equilibrium  points  for  (7)  and  (8).  Writing  these 
equations  in  matrix  form 


iuE{/i(n)i  • 

(oii  +  u;i2a2i)(u’2iaii  +  021) 

■  0  ■ 

(012  +  t^l2<J22)(*^2iai2  +  ^22) 

0 

73 


we  notice  that  if  5ii522  ^  ^12^21  these  equations  are  independent.  Therefore  (13)  and  (14) 
become  zero  if  and  only  if 

(Uii  +  U;i2<*2l)(^2lflll  +  <*21 )  =  0  (16) 

and 

(ai2  +  u;i2a22)(t‘^2iQi2  +  ^22)  =  0.  (IT) 

There  are  two  solutions  for  wn  and  t£>2i  (assuming  ^  ^  ^)- 

^12  ^21 
(^)  *^120ptl  “  ”^12””^^  *^210ptl  ~  ~ 

(-)  “'i2opt2  -  »"2iopt2  -  (19) 

2.2  The  Correlator-Correlator  Scheme 

From  Fig.  3,  the  outputs  of  the  canceler  can  be  written  as, 

yi(n)  =  xi(n)  +  u;i2J2(**) 

y2(n)  =  X2(n)  +  u>2iXi(n).  (20) 

Substituting  (1)  in  (20),  we  get 

yi(**)  =  A  (**)[<*!  l  +  U^12fl2l]  +  f2('*)[<*12  +  U;i2a22] 

y2(**)  =  A(**)[<*21  +  U^2X<*ll]  +  ^2(<*)[<*22  +  U^21<*12]-  (-1) 

The  control  algorithm  simultaneously  minimizes  the  output  correlation  powers  Ci  = 
^l{wi2,W2i)  =  [£'{yi(i(n)j/2(»*)}]^  and  C2  =  B^{wi2,W2-i)  =  [£{t/i(n)y2(i(n)}]^.  It  simulta¬ 
neously  searches  for  dCi{w\2,W2i)ldwi2  =  0  and  dC2{wi2,W2i)ldw2\  =  0,  where  yi^  and 
y2d  are  the  discriminator  outputs.  This  can  be  performed  by  successive  use  of  the  following 
recursive  equations. 


^12 

=  +  [^l(l"l2’'"2l)r 

(22) 

“'21 

=  «^21  +M2^^,j5i(u;i2,U;2l)]^ 

(23) 
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where  Ai(u;i2, u;2i)  and  B,(wu.W2i)  are  the  correlation  between  the  output  of  channel  1. 
and  the  output  of  channel  2  after  discrimination,  and  vice  versa,  respectively.  That  is: 


Ai(u;i2,  =  £’{yi<<(«)y2{«)} 


Bi{wi2,W2i)  =  E{yi{n)y2d{n)} 


SiiE{Ii(n)}{aii  +  u»i2a2i)(  1^21011  +  ^21) 
+S12E  {I2(n)}(ai2  +  0^12022  )(t^21<*12  +  <^22) 

+  Wl202l)i^2l0li  +U21) 
-\-622E{ll(n)}(ax2  +  U'l2a22)(f^21<ll2  +  «22) 


Notice  again  that  for  equations  (21)  and  (22)  to  be  independent,  discrimination  effects  6,j 


are  necessary. 

The  optimum  weights  can  be  obtained  from 


Ati - -  =  -Mi-**Uu^i2i  1^21):^ - .-li(u;i2,u;2i)  -  0 

^  dWi2  <>1^12 

^^C2(wt2i_u^2l2  _  2fi2Bi(wl2,U-’2\)-:r B\{Wi2iW2\)  =  0. 

dW2\  <^^’21 


(26) 

(27) 


It  was  shown  in  [1]  that  for  (24)  and  (25)  to  equal  zero  simultaneously,  it  is  necessary  to 
have  Ai(ii;i2,u^2i)  =  5i(uii2,  u^2i)  =  0.  simultaneously.  Therefore,  equations  (24)  and  (25) 
are  simultaneously  zero  if  and  only  if  Ai(uit2-  U121)  s^nd  fli(u.’i2,  W2\)  equal  zero.  The  optimum 
weights  lUjjopt  ^2iopt  ^^e  found  by  equating  (24)  and  (25)  to  zero,  respectively.  Except 


for  the  normalization  (aissumed  non  zero)  these  equations  are  the  same  as  (13)  and  (14)  so 
that  the  two  possible  optimum  weights  are  the  same  as  in  the  power-power  scheme. 

2.3  The  Power-Correlator  Scheme 
From  Fig.  4  ,  the  canceler  outputs  are 


t/i(n)  =  Xi(n)(l  4- u;i2a’2i)  +  u^2i-r2(«) 

i/2(n)  =  ii(n)u72i  4- X2(n).  (28) 
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Substituting  (1)  in  (28),  we  get 

yi{n)  =  /i(n)[aii  +  u;i2(a2i  +  i«2ian)l  +  h{^)[<^i2  +  u^i2(<i22  +  u'2i<*i2)]  (29) 

y^in)  =  /i(n)[a2i  +  u;2i<*ii]  +  /2(^)[a22  +  ^'21012]-  (30) 

In  this  case,  the  control  algorithm  simultaneously  minimizes  the  output  power  = 
E{yu{n)^}  and  the  correlation  power  Q2  —  =  {^{yi(”)y2<<(n)}^-  It  simultane¬ 

ously  searches  for  dE{yu{ny}/dwi2  =  0  and  dB\{w\2^W2\)ldw2i  =  0,  where  yu,  y2d  are  the 
discriminator  outputs.  This  can  be  performed  by  successive  use  of  the  following  recursive 


equations. 


,‘+i  ^  ».* 


=  u>’i2 +  r^2(“'i2,u^2i) 

CrTI7i2 


^21^  =  lt2-^—Q2{Wx2,W2\)  (32) 

Crtl/2X 

where  nx  and  H2  are  the  constants  which  determine  the  stability  of  convergence.  From  (29). 
we  write  the  power  at  the  output  of  the  channel  1  discriminator 

^’2(^121  ^21)  =  ^ii^{f?(’t)}(aii  +  u;i2(a2i  +  u;2iaii)]^ 

+^i2^{-f|(n)}[ai2  -I-  u;i2(a22  +  ^^21012)]^  (33) 

and  the  correlation  between  the  output  of  channel  1  and  that  of  channel  2  eifter  discrimina- 


B2{wx2,  W2\)  =  ^2i-£'{fi(n)}[an  +  ^12(021  +  u’2i<*ii)][a2i  +  u^2iau] 

+^22^{f2(^)}[°l2  +  U^12(a22  +  U;2iai2)][a22  +  W21<i\2]-  (34) 

Taking  the  derivative  of  (33)  with  respect  to  u;i2  and  and  multiplying  by  the  convergence 
constant  /zi ,  we  get; 

Ml - ^  =  2/ii  (u)}[an -I- u;i2(a2i  +  u;2iaii)](a2i  +  u;2ian ) 


+^i2^{f2(^)}[®i2  +  “^12(022  4*  u;2iai2)][a22  +  11^21012]  ■ 


76 


From  the  definition  of  82(^12^^21)^  we  have  Q2(^i2>u'2i)  —  (■52(^^125 1^21))^'  therefore. 

9Q2{Wi2,W2i)  _  2fi2B2{wu,mi)^—B2{m2yW2l)  (36) 

dw2\  aw2i 

Similar  to  the  correlator-correlator  scheme,  we  showed  in  [1]  that  (36)  becomes  zero  if  and 
only  if  B2iwx2,W2i)  =  0.  Writing  (34)  and  (35)  in  matrix  form  and  equating  the  result  to 
zero; 

^i2^{^2(”)}  (flu  +  tui2(fl2i  +  u;2iaii))(uJ2iaii  +  ^21) 

62i£’{/i(n)}  ^22£'{^2(^)}  .  .  (<*12  +  *^12(022  +  tt;2iai2))(lt>2lfll2  +  <*22) 

We  notice  that  if  5ii^22  ^  ^12^21  these  equations  axe  independent,  so  that  (34)  and  (35) 
become  zero  if  amd  only  if 

(an  -t-  toi2(a2i  +  **^2i<*ii))(*t^2i<*ii  +  <*21 )  = 


III.  STABILITY  PARAMETERS 

Equations  (7)  (8),  (22)  ,(23)  and  (31),  (32)  are  all  nonlinear  in  Wx2  and  k;2i.  Therefore 
to  classify  the  equilibrium  points  of  these  equations  ,  we  will  consider  a  small  deviation  from 
the  equilibrium  points,  i.e,  by  varying  W12  and  W21  to  iWi2opt  +  ^^12  and  i«2iopt  “h  ^<*’21. 
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respectively  with  Awi2  and  Aiwji  very  small.  For  ^w\2  and  small,  any  differentiable 
function  X(ix;i2,u;2i)  satisfying  =  0  can  be  approximated  by 

dXi{Wi2opt  +  Au;i2<  ^>21opt  +  ^^^1  I  . 


dwh 


w _ *  Au;i2 


.  d\X, 

dwi2dw2i  ’^opt 


9X2(u;i2  +  Au;i2,uJ2i  +  ^“^21)  8^X2  ,  ^ 

dw2i  ~  dWi2dW2iOpt^'^^^ 


where 


9^X2 , 

(41) 

^Opt  “  [“^120pt»  *^210pt]^- 

(42) 

i  =  AAw 

(43) 

In  matrix  notation 


where  Aw  =  [Au;i2,  Aii;2:]^  and 

_  rdA'i(t(;i2  +  Ah;i2, u;21  +  ^t^2i)  ^.Y2(wi2  +  Au;i2,u^2i  +  Au;2i)j^ 


where 


a^Y, 

a^v,  , 

dw^2 

5u;i2^iu2i  °P^ 

a».Y, 

a^Y^ 

dwi2dw2i  '^opt 

dw2i  '^opt 

The  stability  of  equilibrium  points  depend  on  the  eigenvalues  of  matrix  A.  Considering 
the  characteristics  equation  of  the  matrix  A  from  |AI  —  A|  =  0,  we  can  hnd  the  eigenvalues 
of  A  by  solving 

A^-bA  +  c  =  0  (46) 
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where 


h  -  ^1 

dwi2  dwh 


,  =  ^1  I  SKX, 

dwj2  '^opt  dw^i  '^<jpt  dw\2d'W2i  '"^opt  dwi2dw2i  '^opt 

The  nature  of  the  eigenvaJues  of  A  in  the  complex  plane,  or  equivalently  the  relation  be¬ 
tween  b  and  c  defined  in  (47)  and  (48)  determines  the  classification  of  the  equilibrium  point. 
Next,  we  intend  to  find  the  different  entries  of  A  for  the  different  bootstrapped  schemes. 


3.1  Stability  Parameters  of  The  Power-Power  Scheme 

Here,  .Yi(  1012, 1021)  and  X2(u;i2, 1W21)  are  given  by  fiiPi{wx2,u}2i)  and  /i2Qi(u^i2,  <^21)- 
respectively  from  (13)  and  (14).  First  notice  that  for  any  rational  function  in  x.  f{x)  = 


i(£),  _  P(x)^-iV(x)^ 

dx  P’(x) 

dNjx)  1 
dx  D{x) 

Using  this  relation  in  (13)  and  (14),  we  get 

d^Pl{'Wl2,W2l).  2/il 


iAr(x)=0 


SnE{P,{n)} 


dwl2  '"opt  (l-u;,,optU'2iopt)n''“^^^^^'‘'^ 
(021  -H  U^210pt‘*ll)<l21  +  di2E{ll{n)}{a22  +  U^210pt“l2)a22) 


d^Ql(Wi2,W2l),  2m2  Fr  r.rr2, 

M2  5  2  -  7~^ - TT  ^21-^iA  (^)} 

^^21  P  (  ^  ~  ^I20pt^210pt)  ^ 

(ail  +  u^i2opt<^2i)aii  +  ^22E{ll{n)}{ai2  +  i«i2opt<^22)ai2  • 

Substituting  for  from  (18)  and  (19)  in  (50),  we  obtain  respectively 


d^Pl{Wi2,W2l) 
'  dwi2 

d^Pl{Wi2,XV2i) 


_  o.  SuE{p2{n)}al2 
-optl  -  (l-rir2)2 

_  8nE{mn)}al, 

^1^2 
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(54) 


and  substituting  WQpt  from  (18)  and  (19)  in  (51),  we  obtain  respectively 

6nE{mn)}a\ 


fi2 


5*Ql(w>X2,tU2l) 

dwli 

I'^Optl  =  2/22 

5^Qi(u?i2,IW2i) 

1  ^ 

5u;2i 

'%pt2  =  -^2 

»n 


(1  - 

622E{qin)}al, 

rirj 


(55) 


Similarly  by  applying  (49)  to  (13)  and  (14)  with  respect  to  W21  and  W12  respectively 

^^Pi(u;i2,tt>2i),  2/i, 


fii- 


dw2idwi2  (1  -  “^i2opt“'2iopt)^[*^"^^^*^^^^ 

•(ail  +  u^nopt  <*21)^11  +  ^12£{/2(’2)}(ai2  +  t«^i20pt<^22)ai2j 


(56) 


fi2 


d^QliWi2,W2i) 


2fi2 


S2iE{I^(n)} 


dW2idWi2  opt  (1  -*"l20pt‘^210pt)' 

■(“21  +  «?2iopt“ll)“21  +  ^22£^{/|(n)}(a22  +  U^210pt“l2 )a22j  ■ 

Also,  substituting  (18)  and  (19)  in  (56),  we  obtain  respectively 
5^Pi(u;i2,iy2i)| 


(57) 


Ml 

Ml 


dw2\dw\2  '"^optl 
g^Pi(u;i2,ii;2i), 
dw2idwi2  '^opt2 


^  (^ii£{/i^(n)}af, 

(l-rir2)2 

_  ^i2^£^{/|(n)}a22 

-  2fii - j - 

(1 - )^ 

riTj 


(58) 

(59) 


and  using  (18)  and  (19)  in  (57),  we  obtain  respectively 

d^Ql{^l2iW2l)  I  „  <^22£'{/2('2)}a22 


M2 

M2 


dw\2dw2\  optl 
^^Ql(tt^l2,W2l), 
dwi2dw2i  '^opt2 


=  2m2 


—  2fi2 


(1  -  r,r2)2 
^2l^{/f(n)}Q;^ 

r,r2 


(60) 

(61) 


Lsing  (52)  and  (54)  in  (47),  we  can  calculate  and  by  using  these  equations  together 
with  (58)  and  (60)  in  (48)  we  can  calculate  CQpj_^. 

Let  ni  =  /i2  =  M,  then  for  the  first  equilibrium  point  (u;i2optl.u'2ioptl)’  ^e  have. 


2m 


^2ioliE  {Iiin)}  +  6i2a22£^{/|(n)} 
,2  _2 


(62) 


■  (l-rir2)^ 

4/z^ 

'^optl  =  ^7J7^“M“u^{/|(n)}E{/2(n)}((52i^i2 -<522<5n).  (63) 
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For  the  second  equilibrium  point,  by  using  (53)  and  (55)  in  (47),  we  calculate  bQpj2  and 
by  using  these  equations  together  with  (59)  and  (61)  in  (48),  we  calculate  CQpj.2; 


ij— +  SnCLl,E{ll{n)) 


(1-— 

Tirj 

Copt2  =  - - al2ahE{l2{n)}E{I^{n)}{62iSi2  -  ^11622)-  (65) 

(1-—)^ 

3.2.  Stability  Parameters  of  Correlator-Correlator  Scheme 

For  this  scheme,  .Yi(u;i2, 1021)  and  X2{wi2,  W21)  are  respectively,  ^i^Pl[wl2^  ii’21 )  =  (^’21  i 

and  H2Qi{wi2,W2i)  =  niB^{wi2,W2i). 


Now, 


d^Pl{wt2,W2l) 


2,W2i)  ^  r/^^l{*"^2,^y2l)^^  , 

— + 


i4i(u;i2,  f^2i ) 


5^.4i(  a’i2. 1^21) 


In  section  2,  we  concluded  that  for  the  optimum  weight,  we  must  have 


Ai(u;i2,io2i)|w  =  0.  Therefore,  (66)  results  in 

OUb 


d'^P\{w\2,U}2\)^ 

dwh  '’^'opt 


=  2mi  ( 


dAi{Wi2.,  W2\  )  I 


^^Pi(u;i2,u^2i)|  _2  ^Ai(u;i2,u;2i)|  g.4i(a-i2,  u.’2i: 

dw2idwi2  ^OP‘  dw2i  '^^opt  0wy2 

Similarly  for  Qi{wi2,iV2i) 


d^Ql{Wl2,W2l)  _  fdBi{Wi2,  W2l)\^ 


l^opt  = 


^^Qi(tni2,u;2i)|  _  0gi(u;i2,  u;2i),  ^gi(a’i2,  0^21) 

dw2\dwi2  '^opt  dw2i  '^opt  dwi2 


,2  'Vf 


Also  using  (24)  and  (25),  we  can  write. 


5Ai(u;i2,  W21) 


=  ^u-£’{/i(j^)}a2i(u;2ian  +  021] 
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+Sx2E{l2in)}a22{w2xai2  +  <122) 

(71) 

dAx{wx2,W2x) 

dW2X 

=  5iiP{/i  (n)}aii(u;i2a2i  +  <*11) 

+^\2E{Il[n)}ax2{xvx2<^22  +  <*12) 

(72) 

dBxiwx2,^V2x) 

dwx2 

=  ^2lP{^l  (’'*)}fl2l(“21  +  1^21^11) 

+^22p{'^2(^)}®22(a22  +  *^21^12) 

(73) 

dBx{wx2,W2x) 

dw2x 

=  ^21-P{-^l(’2)}aii(u;i2U21  +  Oil) 

+^22p{-^2(’^)}“l2(iyi2a22  +  ^n)- 

(74) 

Using  (67)  together  with  (71)  and  substituting  (18),  (19)  we  get  respectively,  for  the  two 


equilibrium  points, 


d‘^Pl{Wx2yW2l). 

^  dw\2  ^opt  1 
Px{wx2^W2l)  . 
duil2  ''^opt2 


=  2^1  <5i2^{/|(n)}a|2(l  -  rjTj) 


^^P\{■WU^W2x)^  ^  \,  r^,r2,  M  2/,  1  si  ^ 

- l''opt2  =  2,i,[i„£{/,(n))a„(l-— )J 


Similarly  using  (69)  together  with  (72),  we  get 

5^Qi(u;12,U;2i)  [  r.fr2/  \1  2/,  si' 

^ - ''^optl  ^  2^2[«52i£{/i(n)}aii(l  -  rjrj) 


r^kot2  =  2/Z2k2^{/2^(ri)}a?2(l-— )]' 

21  upi<:  f’x^2  i 


Also,  using  (68)  and  (70),  we  obtain  respectively,  for  the  two  equilibrium  points. 


g^Pi(u;i2,u;2i)| 

dwx2dw2x  '^optl 

a^Pi(u;i2,u;2i), 

dwx2dw2x  '^opt2 

^^Qi(u^12iU^2i), 
dwx2dw2x  ''^optl 


2^x[E{I^xin)}E{I^{n)}al,al2 

•(1  -  rir2)^5i26n 

2f2x[E{Pxin)}E{ll{n)}al2al, 

•(1 - )^^12^11 

rxr2 

2,22[E{Px{n)}E{p2(n)}al,al2 

•(1  —  rir2)^62i^22 


(79) 

(80) 

(81) 


82 


a^Qi(u>i2,u;2i), 

dw\2dw2\  '"^opt2 

■(1  -  — )"^21<522.  (82) 

rxT2 

Finally,  using  (75)  and  (77)  in  (47),  we  calculate  bi^pt^  and  using  these  equations 
together  with  (79)  and  (81)  in  (48),  we  can  calculate 
Let  fix  =  fi2  =  fi,  then  for  the  first  equilibrium  point. 


^toptl 

*^ioptl 


2a^(1  -  rxr2f[i6x2E{ll{n)}al2f  +  (82xE{ll[n)]a\,f 
4/i^|£{/|(n)}£;{/i(n)}aiia22(l  -rir2)  62i<5i2(<5t2^2i  -^11^22)- 


(83) 


(84) 


Similarly,  for  the  second  equilibrium,  using  (76)  and  (78)  in  (47)  and  (80).  (82)  in  (48), 
we  can  calculate  biQpt2  ‘^iopt2<  respectively; 


u  0.^1  <*11022^2 

Oiopt2  =  2m(^ - 


012021 


(ii,.£{/?(n))a|,f  +  (S22E{Il{n)Wnf 


'loptl  =  E{l}{n))E{I^(,n)]a],alt{l- 


011022 


O12O21 


622<5ii(<5i2<521  ~  <^11<^22)' 


(85) 


(86) 


3.3.  Stability  Parameters  of  The  Power-Correlator  Scheme 

For  this  scheme,  Xi(uji2,  1021)  and  .^2(1012, 1021)  are  given  by  fixP2{wi2,  o?2i)  from  (33)  and 
|i2Q2{^\2^^2\)  =  ^^\BI{wx2,'W2x)  ftom  (34),  respectively. 

From  (35) 


^^^2(1012,1^21) 


dw} 


=  2^1 


12 


^ll^{-^l(”)}(°21  +  I0210pt<*ll) 
+^i2£{/|(n)}(022  +  lOjioptOn) 


(87) 


and  from  (36) 

5^(32(roi2, 1021) 


M2- 


dw\ 


21 


\(9B2{Wx2,W2xW  ,  r>  ,  ,  S2(  t0l2.  1021 ) 

“^^[\ - dw - /  ■^^2(1012,1021)- 


dW2x 


(88) 
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But  in  section  2,  we  concluded  that  at  the  optimum  weights,  we  must  have 


52(1^^127  u;2i)|wqpj.  =  0.  Therefore,  (88)  becomes; 


d^Q2iwi2,W2i) 


fdB2{Wx2,W2i) 

as;;; 


From  (34)  we  find  that 


dB2{Wi2,W2l)  r  r7,,2/  2  . 

—  02i£;{/i  (n)}[aii  +  u;i2an(ui2  +  u;2iaii)] 

^22^  {l\{n))[a\2  +  u^i2Qi2(u22  +  1^21012)]  (90) 

-  =  ^21^{A  (^)}(®21  +  *^2iail)  +  ^22£^{^2(^)}(°22  +  l^2lUl2)^-  (91) 

Substituting  (38)  and  (39)  in  (87),  we  get,  for  the  two  equilibrium  points. 


52^2(10x2,1^21) 


I'^AnXi  2/xi(5,2£{/|(n)}a22(i  _  rjrj)^ 


52P2(u;i2,X02x),  _  o  X  W  2  I,  1  n2 

^^12  A  (^)}‘*2l(^  “■  rr*)  • 


Similarly  (90)  in  (89)  together  and  using  (38)  and  (39),  we  have  for  the  two  equilibrium 


points. 


52^2(^012,^021) 
^  dw^x 
52^2(1012,1021) 


kptl  =  ‘^i^2[S2iE{ll{n)]a\,-  622E{Il{n)}a\^f 
l"^opt2  =  ^f^2[-S2xE{I^(n)}a],+  622E{li{n)}aU\ 


Also  taking  the  derivative  of  (35)  with  respect  to  u;2i,  we  get 

d^P2(Wi2,W2l)  r  T 

Ml  dwx2dw2i  ~  |^^ii-^{A (^)}[oii  +  -*012(021  +  *02ian)aii] 

+5i2£:{/|(n)}[  a^2  +  2u;i2(a22  +  I02iai2)ai2]j . 

Substituting  (38),  (39)  in  (96),  we  get  respectively, 

52/^2(10,2,  W21 ) 

5u;i25u;2i  *’'optl  =  2/ii(^ii£;{/2(n)}aA  -  ^i2£:{/|(o)}aA] 
52^2(1012,0121) 

5101251021  *'^opt2  =  -2Mi[^ii£:{/,(n)}aA -^i2^{AAn)}a?2]- 
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From  the  definition  of  Q2(‘^\2>  ^21)  (36),  we  have. 


d^Q2(m2,^2i)  o  rdB2(Wi3,W2i)dB2(Wi2,W2i)  ^  ^  (  .  (99) 

d‘W2ld‘Wi2  ^  L  dw2l  dw\2  dwi2dw2l 


But  at  equilibrium  point,  ^2(1^121*^21)  equal  to  zero  and  we  get, 


^^<?2(tt*12iU*2l), 

dW2ldtVi2  ^optl 


^  dB2{wi2,U}2\)  ^  3B2(u'i2i  ***2i)  , 

dwi2  '^'optr 


(100) 


Using  (90)  and  (91)  in  (100)  together  with  (38)  and  (39),  we  get  respectively,  for  the  two 
equilibrium  points 

a^Ch(wn,w,,)  ^ 

dWi20W2l  OP'^ 

•622^{/2(n)}a^2(l (101) 

dWi20W2i  OP^*^ 


■S2xE{ll{n)}al,{l - )\  (102) 

rir2 


Finally  using  (92),  (94)  in  (47) ,  together  with  the  definition  of  Xi  and  X2  for  this  scheme, 
we  calculate  b2opti  and  by  using  these  equations  together  with  (97)  and  (101)  in  (48),  we 
calculate  C2opti- 

Let  Hi  =  H2  =  Ml  <^ben 

b2Qptl  ~  2M^^12n|2^{^2(n)}(l  “  *'l*’2)^  +  ~  ^22E{l2{n)}al2 

C2optl  =  V£:{/|(n)}£:{/?(n)}a2,ayi-r.r2)^ 

•  ^^2i£^{^i(n)}ajj  —  ^22^{/2(’^)}®12  (<521^12  —  ^11^22)-  (103) 

For  a  second  equilibrium  point  of  (39)  we  calculate  b2Qp(;2  using  (93)  and  (9-5)  in  (4( ) 
and  by  using  these  equations  together  with  (98)  and  (102)  in  (48),  we  calculate  C2optl-  If 
Ml  =  M2  =  Ml  then; 

>>3opt2  =  2p[«„ai,£{/?(n)}(l  -  +  [-(i„£{/?(n))a;,  +fe£{/J(n))a;,]' 


'2opt2  =  V£{/|(n)}i:{/?(")K.«;i(l  - 


62i^{7i(n)}ajj  —  622^{^2(n)}ai2  (^21^12  —  ^11^22)- 


(104) 
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IV.  STABILITY  CONDITIONS 

From  the  characteristics  equation  in  (46),  the  two  eigenvalues  Ai  and  A2  are  related  to  b 
cind  c  as  they  axe  defined  at  the  two  equilibrium  points; 

The  stability  condition  can  be  summarized  as  follows, 

•  If  c  <  0,  the  eigenvalues  of  (46),  Ai  and  Aj  are  both  real  cind  AjAj  <  0.  Since  one  of 
the  eigenvalue  is  positive  ,  then  the  equilibrium  is  unstable. 

•  If  c  >  0  ,the  two  eigenvalues  are  either  both  read  or  complex-conjugate  pair,  and 
AiAj  >  0.  Both  eigenvalues  (if  they  are  real)  or  their  real  part  (if  they  are  complex) 
axe  negative  if  b  <  0,  positive  if  b  >  0.  Therefore,  the  system  is  stable  if  c  >  0  and 
b  <  0  and  unstable  if  c  >  0  and  b  >  0. 

•  If  c  =  0,  then  one  of  the  eigenvalues  is  zero  an  the  other  one  is  equal  to  b  and  the 
system  is  unstable  [2}. 


4.1  Stability  Conditions  for  The  Power-Power  Scheme 

The  equilibrium  points  for  this  scheme  are  given  by  (18)  and  (19).  First,  for  c  at  the 
first  equilibrium  point  to  be  positive  ,  we  must  have  from  (63);  621^12  >  ^n<522  and  for  b  to 
be  negative,  we  must  have  from  (62)  ;*  <  0.  These  two  conditions  will  result  in  convergence 
of  the  algorithm  at  point  (18).  However,  from  (64)  and  (65)  these  conditions  will  result  in 
divergence  at  the  second  equilibrium  point  in  (19)  (saddle  point). 

4.2  Stability  Conditions  for  The  Correlator-Correlator  Scheme 

The  equilibrium  for  this  scheme  is  the  same  as  the  previous  scheme  and  given  by  (18)  and 
(19).  Again  at  the  first  equilibrium  point  it  is  convergent  if  S21612  >  S11622  and  /ij,  ^2  or  n  are 
negative.  This  results  from  the  signs  of  ci  and  bi  given  in  (83)  and  (84),  respectively.  The 
same  condition  leads  to  divergence  as  a  result  of  the  signs  of  ci  and  bi  given  in  (85)  and  (86). 
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4.3  Stability  Conditions  for  Power-Correlator  Scheme 

The  equilibrium  points  for  this  scheme  zu-e  given  by  (38)  and  (39).  For  C2  at  the  first 
equilibrium  point  in  (103)  to  be  positive,  we  must  have  from  (38)  that; 

1.  ^21^12  ^  ^ii^22i  and 

,  fa  ■ 

and  for  b2  <  0  to  be  negative,  we  must  further  have  ^^x ,  /i2  or  /i  be  less  than  zero. 

For  the  second  equilibrium  point  from  (104),  the  same  conditions  lead  to  divergence. 
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Figure  1  No  noise  dually  polarized  channel  Model. 
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Figure  4  The  Power- Correlator  Cros 
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APPENDIX  C 


BOOTSTRAPPED  ADAPTIVE  SEPARATION  OF  TWO 
SUPERIMPOSED  SIGNALS  - 
DYNAMIC  STUDY  OF  POWER-POWER  SCHEME 
USING  ORTHOGONAL  PERTURBATION  SEQUENCES 


by 

Abdulkadir  Ding  and  Yeheskel  Bar-Ness 


I.  INTRODUCTIONS 

In  a  previous  report  [l],  we  studied  the  steady  state  behaviour  of  the  different  configura¬ 
tions  of  the  bootstrapped  schemes.  In  each  scheme,  the  computation  of  the  optimal  weights 
require  the  knowledge  of  the  channel  model  as  well  as  the  signal  and  the  noise  powers. 

Alternative  procedures  to  find  these  optimal  weights  are  to  use  recursive  relations.  These 
recursive  algorithms  were  presented  in  [1]  Appendix  A  for  power-power,  correlator-correlator 
and  for  power-correlator  schemes.  All  these  recursive  procedures  require  knowledge  of  the 
gradient  of  square  of  the  output  powers  or  the  gradient  of  correlation  between  the  outputs. 

In  this  report,  we  will  present  a  dynamic  analysis  of  the  power-power  scheme.  That  is  a 
backward/ backward  structure  whose  weight  is  controlled  via  minimizing  the  output  powers, 
respectively.  We  will  present  a  technique  for  reaching  the  optimal  weights  with  a  recursive 
weight-updating  procedure  using  estimates  of  the  gradients.  The  estimate  of  the  gradients 
will  be  obtained  by  applying  two  orthogonal  perturbation  sequences  to  the  two  weights 
simultaneously,  and  meaisuring  the  corresponding  changes  at  the  two  output  powers  P  and 
Q  of  the  power-power  scheme. 
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II.  THE  SEPARATOR’S  SYSTEM  AND  PARAMETERS 
2.1  The  Channel 


The  received  signals  sampled  after  matched  filters,  are  taken  to  be; 

xi{n)  =  anli{n)  +  anhin)  +  ni(n) 


(1) 


X2(n)  =  a2iA(n)  +  "b 

where  xi(n)  and  X2(n)  are  the  sampled  received  signaJs  at  the  first  and  second  channels 
respectively.  Ii{n)  and  nj(n)  are  the  corresponding  signals  and  noises  at  these  outputs  such 
that  /,  i  =  1,2  are  M-ary  signals  from  set  {.±  1,  ±3,  ±1. ...  ±  (\/M  -  1)}  and  a,j  i.j  =  1.2 
are  real  channel  couplings.  ni(n)  and  n2(n)  axe  assumed  independent  samples  of  zero  mean 
Gaussian  with; 


E{nf{n)}  =  af,  i  =  1,2. 

2.2  The  Canceler  Outputs 

From  Fig.  1,  the  outputs  yi(n)  and  y2{n)  are  as  follows 

Xi(n)  +  X2(n)u;i2(n) 


(2) 


yi{n)  = 


1  -  Wi2{n)w2i{n) 


y2in)  = 


X2(n)  +  ii(n)u;2i(n) 


(3) 


1  -u;i2(n)u;2i(n) 

Substituting  for  Xi(n)  and  X2(n)  from  (1)  we  get  the  outputs  after  the  discrimination  at 
the  n  th  instant  of  time,  respectively, 

v^/i(n)(axi  +  it;i2(n)a2i)  +  v^/2(n)(ai2  +  u;i2(n)a22)  +  +  ^2(ra)u;i2(n) 


yuin)  = 


1  -  u;i2(n)u;2i(n) 


(4) 

_  \/^A(n)(a2i  +  uJ2i(Ji)<xii)  +  V^h{n){a22  +  «^2i(»^)ai2)  +  ni(n)u;2i(n)  +  n2(n) 

- 1  -  rvr2{n)w2,{n) 

(5) 

where  6ij  i,  j=l,2  is  the  effect  of  the  discriminator  at  output  i  on  the  power  of  signal  j. 
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Also,  from  Fig.  1,  we  can  write  the  weights  Wi2{n)  and  u;2j(n)  as  a  sum  of  a  nominal 
value  u;i2(i)  and  iU2i(i)  plus  perturbation  sequences  p\{n)  and  P2(u)  whose  magnitudes  eire 
A.  That  is 

wnin)  =  iOi2(0  +  Api(n)  (6) 

uj2i(n)  =  u;2i(i)  +  Ap2(n).  (7) 

2.3  Approximate  Canceler  Outputs 

In  ref([l]  Appendix  A),  we  found  that,  in  the  no  noise  environment  the  optimal  weights 
are;  and  in^jopt  = 

Given  that  the  cross-couplines  ^  ^  <<  1,  then, 

r  o  ail 

UJi2(n)u>2i(n)  <<  1.  (8) 


The  assumption  in  (8)  will  be  used  to  simplify  the  analysis  of  dynamic  study.  With  this 
approximation,  we  can  write  (4)  and  (5)  as 

j/i<i(n)  Si  -I- u;i.(n)a2i]  +  y^/2(n)[ai2 -f  1^12(0)022] 

+oi(n) -I- ra2(o)u;i2(o)  [1 -I- u;i2(o)u;2i(n)]  (9) 


y2d{n] 


|\/^2i-fi(o)[a2i  -i-  u72i(o)an]  +  '/^^2(o)[a22  +  u;2i(o)ai2] 
-1-02(0)  -f-  01(72)1021(0)  [1  -h  I0l2(o)u,’2i(7l)]. 


2.4  Mean  Output  Powers 


In  the  steady  state,  using  (9)  and  (10)  respectively,  we  can  write  the  mean  output  powers 
with  weights  fixed  at  lon  and  1021;  P(  1012.1021)  =  ^{(/^^(u)}  and  C?(ioi2, 1021)  =  E{yl^{n)}. 
respectively, 

P{w\2,  W21)  %  ^iiP{/j*(o)}(aii  -h  1012021)^  +  ^i2p{/2(^U(ui2  +  0712022)^ 

-l-£{o^(o)}  4-  E{nl{n)}w]^  (1  +  U7i2i02i)^  (11) 

Q(wi2,W2i)  Si  ^2lP{fi(o)}(a2i  -H  I02iau)^  -f- <522F{/2(o)}(a22  +  1021012)* 

-(-£{0^(0)} -H  E{oJ(o)}io^i  (1 -h  a-i 21021)^  (12) 


9.5 


where  E{(.)}  denotes  the  expected  value  of  (.). 


2.5  Optimum  Weights 

The  optimad  weight  vector;  WQp^  =  [tWi2opt»  “'sioptl^  which  minimizes  the  mean  output 
powers  P  and  Q  are  found  by  taking  the  derivative  of  P  and  Q  with  respect  to  and  W21 
and  equating  the  result  to  zero,  respectively. 

From  (11)  and  (12),  we  get  respectively, 

”  2  (n)} ^(1  +  u;i2iW2i)^(nn  +  iui2a2i )a2i 

+(1  +  ii>i2Uiji)(a„  +  icijaiij^uiji) 

+«„£{/|(n)}({l  +  1^120^21)^(012  +  1012022)022 
+  (1  +  I0l2t02l)(0i2  +  1012022)^1021^  +  £{n,(n)}(l  +  WX2W2\)W2\ 

+  £{n2(n)}^(l  +  10i2l02l)^*0l2  +  (1  +  I0l2l02l)l0i’2“^21^  •  (13) 


dQ{Wi2,W2i) 

dW2\ 


2|^2i£^{/i^(n)}(^(l  +  10121021)^(021  +  I02i0n)oii 
+(1  +  «Ol2l02l)(o21  +  lO2lOll)^l0i2^ 

+^22^{f2(^)}  ^(1^  +  IO12 1021)^(022  +  1021012)012 
+  (1  4-  10i2*02i)(022  +  *O2lOl2)^l0i2^  +  E{ni;(n)}(  I  -!-  fOi2U;2i  )a’i2 
-|-£{n2(n)}^(l  +  «;i2l02i)^U721  +  (I  +  lOi2U'2i)u’2itOi2^  .  (14) 


III.  GRADIENT  DESCENT 

An  alternative  way  to  get  to  the  optimum  weights  is  to  use  gradient  descent  method. 
With  this  technique,  the  weight  vector  at  time  i+1  is  computed  by  using  the  gradients  of 
(13)  and  (14)  according  to  the  following  recursive  relation, 

w-S'  (15) 

(16) 

3.1  Gradient  Estimation  Using  Orthogonal  Perturbation  Sequences 

The  use  of  random  search  and  weight  perturbation  techniques  for  gradient  estimation  in 
adaptive  systems  have  been  reported  by  many  authors  ([2],  [3]).  In  this  report,  we  will  follow 
Cantoni’s  gradient  estimation  definition  [3]  in  which  the  estimate  of  the  gradient  is  obtained 
by  perturbing  the  weights  (different  sequence  for  each  weight)  simultaneously  with  different 
orthogonal  perturbation  sequences  and  correlating  the  outputs  with  the  same  sequences. 
That  is,  the  estimates  of  the  gradients  of  the  outputs  are  obt«iined  from 

,  (i+l)N 

=  51  yfdi^)pM  (17) 

''  m=</V+l 

where  yi^(m)  and  yldi^)  the  instantaneous  powers  of  the  outputs  after  discriminator; 
gi{i)  and  ^2(0  are  taken  as  the  estimates  of  the  true  gradients  given  in  (13)  and  (14). 
respectively. 

The  perturbation  sequences  pi{m)  axe  each  taken  to  be  periodic  with  period  N  and  size  .\ 
which  assumed  a  positive  real  constant  and  are  much  smaller  than  unity.  Different  sequences 
are  mutually  orthogonal  and  zero  mean  over  N  cycle.  For  normalization,  we  divide  by  the 
sequence  period  N  to  obtain  unit  average  power.  Therefore,  such  sequences  will  satisfy  the 
following, 

^£i>*(n)Pl(n)  =  {J  (18) 

nsl  V  ' 

1  ^ 

=  0  /=1,2....  (19) 

n=l 
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rmd  for  higher  moments 


jj'E^Pt{n)Pi{n)  =  |j 


k  =:  I  and  if  both  u  cmd  x  are  even 
k  ^  I  or  if  at  least  one  of  them  is  odd. 


(20) 


It  is  possible  to  find  such  a  family  of  sequences  that  yield  an  unbicised  gradient  estimate 
(for  example,  the  rows  of  Hadamard  matrix  [3])  . 

For  updating  the  weight  vectors  we  use  the  estimated  gradients  gi{i)  and  g2{i)  as  follows 


iui2(i  +  l)  =  wnii)  -  P9i{i) 

+  1)  =  u^2i(*)  -  pg2{i)  i  =  1,2, .. 

and  after  each  recursion  step  the  weights  are  operated  on  by 

u'i2(*  +  l)  =  clip(u;i2(i  +  1)) 

^2iii  +  1)  =  clip(u;2i(i  +  1)) 

where,  clip(-)  is  a  clipping  function  such  that 


(21) 

(22) 


(23) 

(24) 


kl 

<  Q 

1  ,  , 

1  kl 

|u;| 

V 

0 

(25) 

and  fi  is  the  constant  which  determines  the  stability  of  convergence.  The  clipping  operation 
ensures  that  each  weight  is  bounded  by  a  const«mt  a  to  be  less  than  one  so  that  the  desired 
equilibrium  point,  is  reached. 


3.2.  Gradient  Estimates,  ^i(i)  and  g2{i)  for  the  Power-Power  Seperator 

From  (17),  we  write  the  expected  value  of  gradient  estimates  conditioned  on  the  weights 

,  (t+l)/V 

E{9tii)\Mi)}  =  Y,  ^{y/i(”^)|w(0}  Pi(”»)  /  =  1.2. 


(26) 


m=iN+l 

Substituting  (9)  in  (26),  and  taking  the  expectation  of  both  sides  conditioned  on  the 
weight  vector  w(i),  we  get 

,  r 

£^{^i(0|w(i)}  =  ^  Y.  UnE{I^^{m)}{an  +  wu{m)a2x)^ 

m=iN+l  '■ 
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-|-6i2£{/2(m)}(ai2  +  i«i2{m)a22)^  +  £{ni(m)^} 
+£{n2(m)}uji2(m)j[l  +  u;i2(m)ti;2i(m)]V('T^) 


(i+l)iV 


1  '  r 

E{g2{i)\Mi)}  =  Va  H  U2ii^{/?(m)}(a2i  +  u;2i(m)an)^ 

^  m=.N+l  *• 


+^22^{^2(’^)}(®22  +  *^21(^)012)*  + 
+£{nJ(m)}u;^j(m)][l  +  ti;i2{m)u;2i(m)]^P2(m) 


where  u;i2(m)  and  W2i{Tn)  are  the  perturbed  weights  and  related  to  the  nominal  values  wi2(i) 
and  W2i{i)  by  equation  (6)  and  (7).  Using  these  relations  and  the  orthogonal  properties  of 
the  perturbation  sequence  stated  in  (18)  to  (20),  we  find  in  the  of  this  report, 

^{5i(i)|w(i)}  =  2  6ii£{/?(i)}^[l +  u;i2(0w^2i(i)]^[au +  u?i2(i>2i]a2i 

+[1  +  i^i2(0ty2i(f)l[au  +  u>i2(f)a2i(f)]^u;2i(0) 

+^12^{/2(l)}^[l  +  U>12(0^2l(0]^[fll2  +  1^12(0022)022 
+  (1  +  U^12(0o^2l(0][oi2  +  O'12(0o22]^O72i(0^ 

+E{n^(i)}[l  +  u;i2(0o'2i(0]o^2i(0 

+  £{71^(1)}  ^[1  +  U;i2(0iO2i(0]^IO12(0 

+[1  +  u;i2(0«'2i(01o'i2(0o^2i(0)  •  (-9) 

From  a  similar  evaluation  as  well  as  exploiting  symmetry  properties  between  yid(m)  and 

9 

y2d{m)^  we  get  for  the  expected  value  of  gradient  estimator  52(0  conditioned  on  w(i): 

^{y2(0|w(0}  =  2  <52i£'{A^(0}([1  +  lOl2(0o'2l(0]^[o21  +  U72i(Oon]oii 
+[1  +  u;i2(0«>2i(0][o21  +  iO2i(0oii]^u;i2(i)y 

+<522^{/2(0}  +  O^12(0oi2l(0]^[o22  +  O^2l(0oi2]oi2 

+  [l  +  U?12(0o'2l(0][o22  +  U^2l(Ooi2]^lOl2(0^ 
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(30) 


+£{nj(i)}[l  +  u;i2(*)^2i(*)]i«i3(*) 
+£;{n2(i)}^[l  +  u;t2(0u;2i(t)]^u^2i(*) 
+[1  +  lUl2(t)«'2l{i)]u'2l(0u^l2(»))l 


IV.  CONVERGENCE  IN  THE  MEAN 

In  this  section,  we  will  investigate  the  convergence  in  the  mean  of  the  recursive  relation 
in  (21)  (22)  to  the  optimum  weights.  We  will  also  find  an  upper  bound  for  the  step  size  /z 
with  which  such  convergence  in  the  mean  will  occur. 

4.1  The  Error’s  Mean 

Convergence  in  the  mean  of  weight  vector;  w(i)  =  [u;i2(i),  iU2i(i)F  to  optimum  WQpj.  = 
(^i2opt’  ^2iopt]^’  means 

lim£{w(i)}  =  Wopf  (31) 

We  first  define  a  weight  error  vector  at  time  i  as  e(i)  =  [ci(i),e2(i)]^,  with 


ei(z)  =  u;i2(*)  -  u;,2opt  (32) 

62(1)  =  iW2i(*)  -  u^2iopt-  (33) 

We  know  that  at  the  optimum  weights,  the  gradients  of  the  mean  output  powers  P  and 
Q  are  equal  to  zero,  i.e 

dP{Wi2,W2l) 


dwi2 

dQ{Wi2,W2i) 


w  *  =  0 

'opt 

=  0. 


(34) 

(35) 


dw2i  opt 

Subtracting  the  optimum  weights  u;j2opt  '^2iopt  sides  of  (21)  and  (22). 

respectively  and  the  gradients  in  (34)  and  (35)  from  the  estimate  of  the  gradients  gi{i)  and 
g2{i)  in  these  equation  respectively,  we  can  write, 

5f*(u;i2,it;2i) 


u;i2(z  +  l)-u;i2opt  =  «'i2(*)  -  «>i2opt  “  ^ 

U^2l(i  +  1)  -  W210pt  =  -  W2iopt  -  fi 


gAi)  - 

92ii)  - 


dwi2  '^opt 
dQ{wu,W2i), 

'’^opt 


dw 


21 


(36) 

(37) 
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By  using  the  definition  in  (32)  and  (33)  in  (36)  imd  (37),  respectively,  we  write. 


ei(i  +  l)  =  ei(i) -/i  5i(*) - 


aP(ii;i2,  t^2i), 
dwi2 


r  /  x  dQ(wn,  W2i), 

e2(.  +  l)  =  e2(t)-,*[s2(0 - ^ - |w„p, 


In  order  to  investigate  the  convergence  in  the  mean,  we  take  the  expectation  of  (38)  and 
(39)  conditioned  on  the  weight  vector,  w(i).  We  get, 

£:{ei(i  +  l)|w(i)}  =  £:{ei(i)|w(i)} -/i|£{^,(t)|w(z)} 

^fdP(Wi2,W2l),  ,  , 

at., 2 


i:{c2(j  +  l)|w(i)}  =  £:{e2(i)|w(i)} -/i  £:{^2(*1|w(0} 

4.2  Approximate  Terms  for  the  IVue  and  Estimate  Gradients 

In  the  case  when  the  cross  coupling  constants  |^|  and  l^j  are  -10  to  -15  dB  then 
u;i2i«2i  <<  1  ,  and  we  can  approximate  the  true  gradients  from  (13)  and  (14),  by; 

^  ^^'^opt  ^  2  +  u^j2opt‘^2i)«Ji  ■i"  «u'f^’:iopt] 

+^12^1^2  (^)}((®12  +  <222«^120pt)”22  +  «i2^'210pt] 

+  ^{^i(”)}^2iopt  "b  •^{'^i('^)}'‘’i2opt  (■^2) 


^^{y2<i(n)^}, 


2  62iE{/i^(n)}[(a2i  +  a,iu;2,opt)aii  +  ^21  *^120pt] 
+^22£^{f2(”)}l(°22  +  ai2*^210pt)®12  +  «22“^120pt] 
-f-£{nJ(n)}u;2iopt  +  £^{«?(^)}w^i2opt  • 
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Similarly,  uader  the  assumption  that  E{Il{n)}  =  E{Il{i)}  and  E{nl{n)}  =  £{nj(i)}  k 
1,2,  then,  the  estimated  gradients  can  be  approximated  from  (29),  (30)  to  get 

^{5i(01'w(*)}  ^  2  ^ii^{/i(^)}{(<*ii  +  a2iii?i2(*  ))fl21  +  <liiU^2l(0] 
+^12i^{/|(»l)}[(oi2  +  a22“'l2(0)O22  +  ai2^2l(*)] 
+£{n|(n)}u;2i(2)  +  £{nj(n)}u?,2(i)  (44) 

and 

**  2  ^2l£'{^l(^^)}[(<J2l  +  flllU?2l(i))^ll  <*21*^12!  +  <522£’{/2(^)} 

[(<*22  +  ai2U^2l(i))<ll2  +  <*221^12(01 

+£{n2(n)}ti;2i(*)  +  £{n^(n)}u;i2(i)j.  (45) 

Subtracting  the  true  gradients  in  (42)  and  (43)  from  the  estimate  gradients  in  (44)  and 
(45)  ,  we  get  respectively, 

£:{j.(.)|w(i)}  - 

6„£;{/2(n)}a|Ju;i2(i)  -  u^ijoptl  +  ^\2E{ll{n)}a\^[w^2{i)  ~  u^ijopti 
+^i2^{/2(n)}ai2[u;2i(i)  -  u^2iopt]  +  ^{^?(^)}k2i(i)  -  u'2iopt] 

+£;{n|(n)}[u;j2(2)  -  U7i2opt]  -  (46) 

£{y,(i)|w(.)}  -  =  2[ii,.£{/?(„)}„;.[,„,.(i)  -  a,,.op,l 

^21-£’{/l(n)}a|i[li;i2(2)  —  WjjoptI  +  <^22-^{/2(’’)}°22[*"l2( 0  -  '^I20pt] 
+^22E{I^{n)}al2[w2l{i)  -  U;21opt]  +  ^{^l(«)}[l"2l(«)  -  l021Opt] 

+£:{n^(n)}[u;i2(i)  -  u^ijopt]  (47) 

Using  (46)  ,  (47)  in  (40)  and  (41)  respectively,  we  have 

£{ei(i  +  l)lw(z)}  =  (1  - /xa)£{ei(i)lw(i)} 

-/z6£{e2(i)|w(i)}  (48) 
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£{62(1  +  l)|w(i)}  =  -Mc£{ei(01w(i)} 

+(1  - /x<f)£:{e2(i)|w(i)}  (49) 

where 

a  =  2[6i2£:{/2(n)}a22  +  6ni:{/2(n)}a2,  +  £{n2(n)}]  (50) 

b  =  2[<5ni;{/i(n)}a?i +6i2£{/|(n)}ai2  +  ^{^i(”)}] 

c  =  2[8-22E{ll{n)}al^  +  62iE{Ii{n)}al^  + E{nlin)}]  (52) 

d  =  2[62i£{/?(n)}a^j +  622£{/|(n)}ai2  + £{ni(n)}].  (53) 

In  matrix  notation,  we  can  write 

E{e{i  +  l)|w(i)}  =  (I  -  nA)E{e{i)\w{i)}  (54i 


where  I  cind  A  are  the  identity  and  the  weight  error  matrices,  respectively. 

A  f  ®  ^  1 

d\ 

Taking  the  expected  value  of  (53)  over  the  weights.w(i)  we  can  write  . 

E{e{i+l)}  ={I- fiA)E{e{i)}.  (56) 

If  HI  —  ^A|l  <  1  then  lim,_oo  £^{e(*)}  “♦  0-  Therefore,  we  can  establish  an  upper  bound 
for  the  convergence  constant  n 

^  1 

0<fi<  -  (57) 

''max 

where  Amax  is  the  maximum  eigenvalue  of  the  weight  error  matrix  A. 

V.  RESULTS 

Using  a  computer,  we  simulated  nondispersive  fading  channel  and  employed  a  power- 
power  canceler  to  eliminate  the  effect  of  cross-pol  interference.  Perturbation  sequences 
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used  in  the  computer  simulation  are  chosen  from  the  rows  of  Hadamard  matrix  (i.e  pi  = 

andp2  =  [1,1, -1,-1, 1,1,..]). 

The  block  diagram  of  the  power-power  canceier  using  perturbation  sequences  in  the  con¬ 
trol  algorithm  is  given  in  Fig.  1.  We  applied  two  independent  uniformly  distributed  bipolar 
data  to  the  nondispersive  channel.  Then,  corrupted  data  is  applied  to  the  canceier.  In  Fig. 
2,  the  interference  power  residue  versus  the  data  sample  is  given  for  -14  dB  cross-pol  interfer¬ 
ence  with  the  perturbation  length  N=8  and  different  perturbation  magnitudes  A.  The  same 
experiment  is  done  for  different  perturbation  sequence  sizes  and  depicted  in  Fig.  3.  The 
results  depicted  in  these  figures  aforementioned  are  the  average  of  four  random  experiments. 

VI.  CONCLUSION 

In  this  report,  we  studied  the  dynamic  analysis  of  the  power-power  canceier  by  using 
orthogonal  perturbation  sequences  in  the  control  algorithm.  The  results  of  the  computer 
analysis  shows  that  as  the  perturbation  magnitude  is  reduced,  the  interference  power  residue 
decreases.  Also,  as  the  perturbation  sequence  length  is  increased  a  smooth  estimate  of  the 
gradient  is  obtained,  but  the  convergence  time  takes  longer,  as  expected. 

We  conclude  perturbation  sequences  can  be  used  effectively  in  cross-pol  interference  can¬ 
celation. 
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Figure  1  Power-Power  Cross-Pol  Interference  Canceler  controlled  by  orthogonal 

perturbation  sequences. 
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Figure  2  Effect  of  different  perturbation  magnitudes  on  convergence. 
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Figure  3  Compaxison  of  different  perturbation  lengths  on  convergence. 
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VIII.  APPENDIX 


^{5i(i)lw(i)}  =  E{gn(i)\w{i)}  +  E{gi2{i)\Mi)} 

+E{giz{i)\w{i)}  +  £{<;i4(*)|w(i)} 


(P-1) 


where  gn,  fc  =  1,  ..4  axe  the  different  four  terms  in  (27).  For  the  sake  of  simplicity,  we 
evaluate  (27)  term  by  term. 


That  is; 


£){5ii(0|w(z)}  =  Y1  (on  +  wnim)a2i)‘^ 


mstiV+l 


•[1  -h  u;i2(m)u;2i(m)]Vt(m) 


(P-2) 


....  ....  A  S,2E{q{i)}  ,  ,  ,  ,  ,2 

E{gi2it)hil)}  =  - 777 -  2-  (ai2  +  Il>i2(m)a22) 

^  m=iiV+l 

•(1+ u;i2(m)u;2i(m)]Vi(n2)  (P-3) 

A  b+l)/v 

E{gi3{i)\^{i)}  =  — 777 —  H  [1  +  i"i2('7i)iw2i(m)ppi('7i)  (P-f) 

m=..V+X 

^{^I4(i)|w(i)}  =  - u;j2(m)[l -|-u;i2(m)u;2i(m)]Vi(m)  (P-.5) 

m=iN+l 

where  we  also  used  the  fact  that  the  random  sequences  Ii{i)  and  nt{i)  /  =  1.2  are 
stationary. 

Using  (6),  (7)  in  (P-2),  we  can  get; 


E{gu{i)\Mi)}  = 


«..£{/?(.)}  "iU" . . 

- 777 -  2^  (oix -I- +  Api(m)]a2i) 

m=»VV+X 

■^1  -I-  [u;x2(i)  -I-  Api(m)l[u;2x(0  -f  Ap2(m)]^  Px(m) 

6uE{lUi)}  ^  . 

- 777 -  2-  -Mx(m)Ai2(m)p,(m) 

^  m=..v+x 


(P-6) 
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where. 


=  (ail  +  [1^12(0  +  Api(m)]a2i)*  (P*0 

A’i2(m)  =  ^1  +  [uJi2(0  +  Api(m)][u?2i(0  +  Ap2(m)]^  (P-8) 

As  a  function  of  the^ perturbation  pi{m)  and  p2(n2),  we  write  (P-7)  and  (P-8)  as 

Xii(m)  =  A ->r  B ^pl{m)  +  C \^p\{m)pi{jn)  (P-^) 

Xi2(m)  =  D-|-£;Api(m)-bFAp2(m)-j-GAVi(m)p2(m)-H/fAVi(m)pi(m) 

+I  A^P7(m)p2im)  +  J  A^Pi{Tn)p2{m)p2(m)  +  XA^P2(jti)Pi(^)Pi(’^) 

-t-A'‘pi(m)pi(m)p2(m)p2(m)  (P-10) 

where, 

A  =  [an -b  a2iiyi2(i)]^  (P-H) 

B  —  2a2i[au  +  a2iu>i2(i)]  (P*12) 

C  =  a],  (P-13) 

D  =  [H- u;i2(i)u;2i(i)l^  (P-1‘1) 

E  =  2(1 -I- u;x2(i)u;2i(0]u^2i(0  (P-15) 

F  =  2(1 -f  iui2(*)a^2i(0]u'i2(0  (P-16) 

G  =  2(1 -I- 2u;i2( 00^21(0]  (P-17) 

H  =  u;2i(*)  (P-18) 

/  =  w^i)  (P-19) 

J  =  2‘Wi2{i)  (P-20) 

K  =  2u;2i(i)  (P-21) 

Therefore,  from  (P-6),  and  by  using  the  orthogonal  properties  of  the  perturbation  se¬ 
quences  pi(m)  and  p2(m),  we  get 

E{9l.(i)|w(i))  =  +  fiD)A)V 
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+{AJ  +  BH  +  BI  +  CE)\^N  +  {B  +  CJ)A^N]  (P-22) 

For  A  <<  1  the  second  and  the  third  terms  in  the  parenthesis  is  small  in  comparison  to 


the  first  and  we  have, 

«  6r^E{Il(i)}{AE  +  BD)  (P  -  23) 

with  A,  B,  D  and  E  defined  in  (P-11) ,  (P-12) ,  (P-14)  «ind  (P-15)  respectively.  Therefore; 

^{i?ii(0|w(i)}  as  2<5n£'{/j(i)}^[aii  -f- a2i“^i2(i)]^[l  -f  u;i2(0ty2i(i)]t^2i(0 

-^[an  -f  021 1«12(*)] 021(1  -t-  tUl2(l)tW2l(0]^  (P-24) 

Similarly,  using  (6)  and  (7)  in  (P-3),  we  get. 


^{^i2(i)|w(i)}  = ^  Xi3(m)Xi2(m)pi(m)  (P-25) 

m=,iV+l 

where, 

Xi3(m)  =  (oi2  -I-  [ti;i2(t)  -f  Api(m)]o22)^  (P  -  26) 

and  *Yi2(m)  as  in  (P-10). 

As  a  function  of  the  perturbation  pi(m),  we  write  (P-26)  as 

-Yx3(m)  =  Ai  -f  Bi\pi{m)  +  CiA^Pi(m)pi(m)  (P  -  27) 

where. 
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For  A  <<  1,  the  second  and  the  third  terms  in  the  parenthesis  is  small  in  comparison  to 
the  first  and  we  have, 


(P  -32) 


with  Ai,  Bi,  D  and  E  defined  in  (P-28),  {P-29),  (P-14),  (P-15),  respectively.  Therefore, 


^{yi2(*)|w(i)}  w  26i2i^{/|(i)}^[a,2-|-a22U>X2(01^[l  +  ?"i2(0w'2i(»)]u^2i(i) 


+  [<*12  +  <*22M^12(*)1<*22[1  +  l<^12(i)*<^2l(*)]^  • 


(P-33) 


Again,  using  (6)  and  (7)  in  (P-4)  ,  we  get. 


^{^i3(i)lw(i)}  - - —  Y.  -Yi2(m)pi(m) 


mstN+l 


with  .Vi2(m)  as  in  (P-10). 


Applying  the  orthogonal  properties  of  the  perturbation,  we  get 


(P-34) 


(P-35) 


For  A  small  the  second  term  can  be  neglected  and  using  (P-15)  and  {P-20)  in  (P-35),  we 


^{^i3(0|w(i)}  «  2£{n^(i)}[l  -h  u;i2(i)u;2i(0]u^2i(i)- 


(P  -  36) 


Finally,  using  (6)  and  (7)  in  (P-5),  e  get. 


Efn'^aW 

^{fi'i4(*)|w(i)}  =  — Trr —  Y  -Yi4('^)^i2{m)pi(m)  (P  -  37) 


m=iiV+l 


where; 


Xn{m)  =  [u;i2(i)  +  Api(m)]^ 


=  wl2{i)  +  2u;i2(i)Api(m)  -I-  AVi(»7i)pi(m) 


(P-38) 


and  A’i2(m)  as  in  (P-10). 
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Again  applying  the  orthogonal  properties  of  the  perturbation,  we  get 


+[£  +  2'Wi2{i)H  +  2/u>i2(i)  + 

+(J  +  2u>i2(i))A*,V.  (P-39) 

With  the  same  approximation  in  (P-33),  we  can  write 

E{9u{i)\^ii)}  ss  E{nl{i)}[2D  +  Ewi2(t)]u!\2it)-  (P-40) 

With  D  and  E  defined  by  (P-14)  and  (P-15),  respectively.  Therefore, 

£■{^14(01^(1)}  s:  2£{n|(i)}|[l -f  u?,2(i)uJ2i(0]^ 

4-[l -I- u;,2(i)u;2i(i)]u?2i(0u?i2(i)  it',2(i)-  (P-41) 

Combining  the  four  terms  from  (P-24),  (P-32),  (P-36)  and  (P-41)  in  (P-1),  we  write, 

£{^i(0|w(i)}  =  2|^n£{/i^(j)}^[l  4-  iui2(t)u;2i(i)]^[an  4-  u^i2(i)a2i]a:i 
4-[l  4-  iui2(i)u'2i(i)][aii  +  iyi2(i)a2i(0]^ii'2i(0) 

-f-^l2£{/2(*)}  ^[1  4-  U^12(0u^2l(01^lfll2  +  '^12(0fl22]a22 
+  [1  +  U'l2(»)«^2l(0]lai2  +  U^12(i)a22]^U'’2l(0j 
+£{^?(»)}[1  4-  u^i2(i)u;2i(i)]u;2i(0 

4-£{a^(i)}^[l  4-  u;i2(j)u;2i(0]^ii'i2(<) 

4-[l  4- u;l2(^)u;2l(^))u;^2(^)«i'2^(^))  •  (P-42) 

Similar  lengthy  manipulation  can  be  applied  to  obtain  the  estimate  of  the  gradient  of 
Q  with  respect  to  u;2i.  However,  due  to  the  symmetry,  we  can  obtain  (?({t’i2,  it’21 )  from 
P(a’i2,u;2i)  by  taking  hit).  ^2(1’),  022,  <*211  u'21  respectively  instead  of  /,(j).  n\(i),  ou.  012. 
(i;i2  and  vise  versa.  Also,  replacing  d'n  and  612  by  ^22^  ^21- 
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Applying  these  changes  and  replacements  to  (P-42)  we  get, 


^{^2(t)|w(z)}  =  2  +  ^i2(*)^2i(*)]^[®2i  +  u;2i(i)axi]au 

-h[l  -I-  U>t2(*)**’2l{»)][®21  +  U72l(0fln(*)]**^l2(*)^ 

+^22^{-^2(0}  +  U;i2{*)n>2l(*)l^lo22  +  U'2l{*)<*12]ai2 

+[1  +  iyi2(*)i‘>2i(t)][«22  +  u;2i(t)ai2]^u;i2(i)) 

-|-£:{nj(t)}(l  -j-  Wi2{i)w2iii)]wi2{i) 

-l-£^{n^(i)}([l  -t- u>i2(i)u>2i(*)]^i^^2i(i) 

+  [1  -l-UJl2(*)t«2l(*)]w^2l(*)w'l2(»))]-  (P-43) 
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APPENDIX  D 

BOOTSTRAPPED  ADAPTIVE  SEPARATION  OF  TWO 
SUPERIMPOSED  SIGNALS  - 
DYNAMIC  STUDY  OF  POWER-CORRELATOR  SCHEME 
USING  WEIGHTS  DITHERING  WITH  PN  SEQUENCES  ‘ 


by 


Ruth  Onn  and  Yeheskel  Bar-Ness 


ABSTRACT 

This  report  considers  the  dynamic  behavior  of  a  blind  signal  separator,  suggested  and 
study  by  on  of  the  author  (Bar-ness).  In  this  implementation,  the  error  functions,  which 
are  derivatives  of  easily  calculated  functions,  are  estimated  by  adding  a  dither  series  to  the 
weights.  The  resulting  differential  equations  are  analyzed.  Constraints,  imposed  on  the 
various  parameters  by  the  need  for  stability  in  the  control  loops,  are  found,  as  well  as  the 
sensitivity  of  the  output  to  the  interfering  input. 


‘This  work  was  presented  at  CISS  held  at  Johns  Hopkins  University,  March  1993. 

This  work  was  partially  supported  by  a  grant  from  Rome  Air  Force  Lab,  (AFSC),  Griffis  Air  Force  Base. 
N.Y.,  under  contract  F30602-88-D-0025,  Task  C-2-2404. 
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I.  INTRODUCTION 

The  topic  of  blind  signal  separation  has  recently  been  attracting  vast  interest  junong 
researchers  [1,2].  Three  structures  of  two  signal  blind  signal  separator  were  suggested  in 
[3].  They  can  be  adaptively  controlled  by  either  output  power  minimization  and/or  output 
de-correlation.  It  was  shown  that,  in  the  absence  of  noise,  these  criteria  lead  to  totai  signal 
separation.  The  research  group  at  the  Center  for  Communication  and  Signal  Processing 
at  NJIT  has  been  examining  this  separator,  analyzing  both  its  theoretical  aspects  and  its 
practical  applications.  This  work  has  resulted  in  a  few  journal  articles  dealing  with  the 
bandwidth-complexity  tradeoff  [4],  the  question  of  noise  effect  [5],  spatial  separation  of  wide¬ 
band  sources  [6],  etc.  Application  to  satellite  and  microwave  digital  communication  links 
were  also  examined  [7,8] .  Recently  some  results  were  obtained  in  applying  the  blind  separator 
to  decision  feedback  adaptive  chaimel  equalization. 

This  paper  cpnsiders  the  dynamic  behavior  of  these  separators.  In  order  to  obtain  a 
gradient  of  the  output  power  needed  to  control  the  weights,  a  pseudo-random  sequence  is 
used  to  dither  the  weights.  Minimizing  the  magnitude  of  the  correlation  between  the  two 
outputs  is  effected  directly  by  forcing  the  correlation  to  zero. 

As  was  shown  in  [5],  one  of  the  structures,  called  Forward/ Forward,  must  be  controlled  by 
correlation  zero-forcing.  Another  structure,  termed  Backward /Backward,  can  be  controlled 
by  either  minimum  power  or  correlation  zero-forcing. 

In  this  paper  we  will  concentrate  on  a  two  input  two  output  configuration,  with  the 
Forward/ Backward  structure,  see  figure  .  One  weight  will  be  controlled  by  minimum  output 
power,  while  the  other  by  zero-forcing  of  the  correlation  between  the  two  outputs.  Dynamic 
behavior  of  the  other  two  structures  can  be  similarly  analyses. 

Following  the  notation  in  [5]  the  two  inputs  to  the  interference  cancelled  are  given  bv; 

Xx(<)  =  St(t) -|- aiS2(t) 

X2(t)  =  a2Si(t)  -I- S2(f) 
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where  oi  and  02  are  unknown  complex  numbers,  3i(i)  and  S2{t)  uncorrelated  signals.  The 
separation  is  attempted  by  applying  complex  weights  wi  and  to  the  inputs  to  obtain 
(possibly  scaled)  estimates  of  the  signals. 

>si(0  =  J/i(0  =  xiit)  + 
h{t)  =  y2{t)  =  U?2Xi(0  +  ^2(0 

Based  on  considerations  of  complexity  and  bandwidth,  error  functions  are  chosen  to  control 
the  separating  weights.  Estimates  of  the  error  functions  are  integrated  to  form  the  weights. 
In  this  implementation  a  dither  series  is  added  to  the  weights,  and  the  error  functions  which 
are  derivatives  of  easily  calculated  functions  are  estimated  in  this  way.  Thus,  the  weights 
are  composed  from  the  controller  output  and  the  dither  sequence  . 

fiw^  n  =  1, 2  ( 1 ) 

The  dither  sequence  is  scaled  by  a  small  constant  /z,  chosen  so  that 

^  «  |u;^l  n  =  1,2  (2) 

The  complex  dither  sequences,  luf  n  =  1,2,  are  produced  from  two  uncorrelated  pseudo¬ 
random  sequences  by  staggering  the  real  and  imaginary  part. 

(0  =  ^  =  1,2 

where  j  is  the  square  root  of  minus  one.  Thus 

E  [w^Kii)w^Lii)\  =  0  for  K,L  =  RJ 

where  E  [•]  is  the  expectation  operator.  This  implies 

E[wi{t)w2{t)]  =  0 
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n.  THE  POWER  CORRELATOR  DITHER  CONTROLLED  SIGNAL 
SEPARATOR 

This  scheme  of  separating  the  signal  involves  a  trade-off  between  complexity  and  b«ind- 
width  [4].  It  is  composed  of  two  loops,  one  is  controlled  by  the  power  in  one  of  the  outputs, 
the  other  by  the  cross-correlation  of  the  two  outputs.  The  power  controlled  weight,  which  we 
deal  with  first  necessitates  estimating  the  derivative  of  the  power  function  with  respect  to  the 
controlled  weight.  The  second  weight  is  controlled  directly  by  the  sample  cross-correlation, 
and  therefore  no  dither  has  to  be  added  to  it. 


2.1  The  Power  Controlled  Loop 

The  output,  the  power  of  which  controls  the  first  weight  is 

y\it)  =  (1  +  wi{w2  +  a2))si  +  (oi  +  u)i(l  -f  aiW2))s2  (3) 

Substituting  (1)  into  (3)  and  dropping  the  dependence  on  t  we  have 

yi  =  (1  +  (iwf -f /lu;f)(u;2-^-a2))Sl-^- 
(a^  +  +  tnf  )(1  -i-  aiu;2)52 

=  (1  +  wf  {w2  -l-  a2))si  -H  (oi  Wi  (1  -l-  aiu;2))s2+ 

{{{W2  +  a2)si  -I-  (1  +  aiu;2)s2)u;f ) 

Where  we  used  (2)  to  disregard  entries  with  Taking  the  power  of  yi  gives 

lyil^  =  |(1  +  wf  (w2  -H  a2))si  -}-  (ci  -H  iwf  (1  -b  aiu;2))s2j  + 

[((1  +  wf{w2  +  a2))si  +  (a,  -H  lyf  (1  -f-  aiu;2))s2) 

((«'2  +  02)^?  +  ((1  +  ai*‘"2')^2)^f‘)] 

where  the  superscript  ’  denotes  the  complex  conjugate  and  3?  (•)  denotes  the  real  part.  When 
we  average  the  power  over  a  proper  time  period,  we  can  assume  that  =  0.  thus 

|j/iP  =  |1  +  wf{w2  +  a2p|sip  -I-  |ai  +  +  aiu;2)|2]slj2 

2/*^  [((1  +  (^2  +  a2))(w'2  +  a2)l'®iP  + 

(oi  +  u;f  (1  +  aiii;2))(l  -|-  aiu;^)!^)  luf*] 
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This  signal  is  passed  through  a  capacitor  which  we  will  assume  ideally  suppresses  all  entries 

that  do  not  depend  on  u;f  or  iwf  * 

lyiPUc  =2/i3?[((l  +  u;f(u;2  +  a2))(u^2  +  “2)|5ii^+ 

(ai  +  u;f  (1  +  aiii;2))(l  +  ajii;2)ls2|2  )  u;f*j 

Taking  the  product  of  the  above  with  the  dither  luf  gives 


fii  —  2/i  ^(1  +  u;f  (u;2  +  a2))(u;^*  +  a2)lsiP  +  (5) 

(oi  +  u?f(l  +aiu;2))(l  +a>f*)ls2l2)  +  (6) 

/i  ((1  +  wf‘{wl  +  al)){w2  +  a2)|siP  +  (7) 

(aj  +  u;f*(l  +aiiy;)){l  +aiu;2)|s2p)  (u;^)*  (8) 


We  used  P  =  2,  which  follows  directly  from  the  definition  of  the  dither  signal. 
The  control  signal  is  next  passed  through  a  filter  with  the  response 


-9 

1  +  rp 


Cl 


where  p  is  the  Heavyside  differentiation  operator.  Note  that  (a-f  We  will 


choose  the  time  constant  r  in  the  filter  to  be  such  that  the  time  average  can  be 

substituted  for 

(1  +  r—  +  2gp  |lu;2  +  a2p|sip  +  |1  +  aia’2p|s2p  )a'f  = 

-2gp  (W2  +  a2)‘|siP  +  ai(l  +  aiu;2)*ls2pl  +  (9) 

-2jgp  [lu;2 +  a2l^l5iP  +  |1  +  aiu;2|^ls2P]  af  •(a'Pfla'P;)  -i-  (10) 

-2;pp  [(u;2 +a2)|sxP +  aj(l +aiu;2)l^]  ('tffltif/)  (11) 

The  operator  notation  was  replaced  by  the  regular  ^  notation.  The  terms  in  (9)  through 

(11)  have  the  following  interpretation.  The  first  term  is  the  desired  one.  for  in  the  steady 

state,  when  -^iwf  =  0,  it  leads  to 
at 

Q  ~2yp  [(u;2  +  a2)*|'SiP  +  ai(l  4-  aiu;2)*|s2P 

ly,  =  - i - - - L 

1  +  2gpG 
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with 


G  =  |k;2  +  +  |1  +  aiu;2|^|s2P 


This  is  the  optimal  solution  for  the  power  controlled  weight,  provided 

l«2gtJiG  (13) 

(see  [3]  equation  (30)).  The  rest  of  the  terms,  as  well  as  the  dither  added  to  will  cause 
degradation  of  the  separation,  relative  to  the  optimal  value  predicted  in  [3]. 

These  must  be  held  to  an  acceptably  small  level.  The  terms  in  (10)  represent  the  cross 
coupling  of  the  real  and  imaginary  parts  of  luf ,  and  thus  affect  its  dynamic  performance.  In 
(10)  the  coupling  is  weighted  by  the  correlation  between  the  real  and  imaginairy  part  of  the 
dither  sequence  iwf . 

Taking  into  account  at  first  only  the  contributions  of  (9)  and  (10)  we  obtain  the  following 


differential  equation 


r^iuf  =  -(1  +  2gfiG)w^  -  2jgn(^^nW^^w’{‘ 

-2gn  [(u;2  +  a2)*|5iP  +  ai(H-  aiu;2)"ls2|2 


The  differential  equation  (14)  can-be  written  in  vector  form 


d  r 


1  +  2gfiG  2gfiG{w^[iW^^ 


2gfiG{w^jiW^^  1  +  2gfiG 


((tU^  +  02)131 12  + 

(Oi  +  |aipu;f)|s2P) 
-((u;^  +  a2)|sii2  + 

(oi  -  |aipu;f)|s2P)^ 


The  eigenvalues  of  (15)  are  given  by 


Ai  =  I +2gnG{l  + 


A2  =  1+  2gnG{l  -  {w^nWi^) 
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Thus  the  system  is  stable  only  if 

1  +  IgtiG  >  2gfiG(fVinW^^ 

and  taking  (13)  that  means 

l>{winw^^  (18) 

The  term  in  (11)  is  expected  to  affect  mainly  the  steady  state  response  of  .  We  are 
especially  concerned  in  how  it  affects  the  sensitivity  of  Ji  to  sj.  Thus  we  define  yn  and  yi2 
as  follows 

Viit)  =  yusi{t)  +  ynS2{t)  (19) 

i/u(0  =  I  +  {^2  +  <12)  +  y-wf  (W2  +  a2)  (20) 

yi2it)  =  +  u;f(l  +  aiiwj)  +  ^iwf(l  +  fliioj)  (21) 


1/12(0  — 


Rearranging  (9)  and  (11)  we  have 

^  _  -2gy  [(u;2  -I-  a2)*pIF  +  qi(l  +  Qit^2)*k2P] 

1  +  rp  +  2gfiG 

-2gn  [(u;2  +  <i2)\si\‘^  +  ai(l  +  01^2)132^]  {wirW^^ 

1  +  rp  +  2gnG 

Substituting  (22)  into  (21),  and  using  the  definition  of  G  in  (12),  we  get 

oi  -  2gfiiw2  +  aO(l  -  aia2)|3iP 
^  1  +  rp  +  2gnG 

~2gn  [(u;2  +a2)|siP  +ai(H-a,u;2)|s2p  (1  +  aiu;2)(u;f;?u;f;) 

1  +  rp  4-  2gtiG 

+  mrxtuf  (1  +  aiiW2) 

To  get  the  sensitivity  we  are  seeking  we  will  consider  E  [lyi2n- 

E  [ly  |2]  ^  Qi  -2gp(ti;;  +a;)(l  -qia2)kiP  ^ 

1  '  1  +  rp  +  2gpG 

+  4gV0H-aii»2n(i«2  +  a2)l5iP 


+  ai(l  +  aii(;2)|s2P  I^E 
+  2p^|l  +  aiu;2|^ 


1  +  rp  4-  2gpG 
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To  evaluate  (23)  we  will  use  the  fact  that  the  sequence  chip  rate  j  is  much  greater  than  the 
closed  loop  bandwidth.  We  will  approximate  the  sequence  by  Gaussian  noise  with  the  same 
power  density  value  of  "lirT over  the  closed  loop  bandwidth.  For  a  low  pass  filter,  the 
two  sided  noise  bandwidth  equals  the  reciprocal  of  twice  its  time  constant.  Therefore 


2' 

1  2x7(1 +2ngG) 

1  -H  rp  -1-  2gfiG 

il  +  2figGy  2t 

tT  1 
T  1  +  2figG 


Substituting  in  (23),  the  equation  reads 


[lyi2p]  = 

ai  -  2gn{wl  +  a;)(l  -  axa2)|si|2 

2 

1  +  rp  +  2giiG 
iirTgV  ^ 

T 

|1  -H  aiu;2p|(w2  +  a2)|5iP  +  al(l-f  aiu;2)|s2P  1^ 

1  -H  2figG 

+  axW2^ 


(24) 

(25) 


(26) 


The  expression  in  (24)  dominates  the  right  hand  side  of  the  equation.  Under  the  assump¬ 
tion  1  <<  2gnG  it  will  yield 

T7  r.  I2l  |(«'2 +  a2)(l -aia2)|5i|2 

E  [IjuI'I  =  1 - - 


G2 

Which  is  exactly  the  one  in  [3].  (25)  represents  the  effect  of  non-zero  chip  duration,  and  will 
be  made  small  by  making  the  chip  duration  as  sm€dl  as  possible.  It  will  increase  with  ng. 

(26)  imposes  the  limit  on  the  size  of  /z.  This  will  make  obtaining  a  large  fxg  hard  without 
a  large  g.  The  size  of  g  is  in  turn  limited  by  considerations  of  stability,  which  will  come  up 
if  the  loop  is  not  simply  first  order. 


2.2  The  correlation  controlled  loop 

In  this  loop  the  weight  is  controlled  by  the  average  power  in  the  sample  correlation 
between  the  two  outputs,  As  is  proven  in  [3],  the  relevant  signal  in  the  derivative  of 
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the  power  is  the  cross-correlation  itself,  thus  we  do  not  need  to  add  a  dither  component  to 
W2.  The  averaging  time  constant  is  chosen  such  that  the  output  depends  only  on  the  power 
in  the  signals  si  and  s^. 

The  inputs  of  the  correlator  are  the  two  outputs  of  the  circuit.  Recall 

yi  =  ((^i  +  ai52)(l -H  luiiyj) -t- (02^1  +  52)iyi)’ 

=  s{(wl{w^  -I-  02)  -f  1)  -I-  sl(w^{alwl  -I-  1)  -F  aj) 

J/2  =  (•si -I- aisi)u;2 -I- (a2Si -I- S2) 

=  Si(iW2 -h  <*2)  +  •*2(011^2 -!■  1 ) 

Averaging  the  product  of  the  two  inputs  gives 

*1*2  =  [.SiP  -F  g^j  -I-  l)(ti;2  +  02)+ 

IS2P  (u;J(aiu;2  +  1)  +  ai)(aiu;2  +  1) 

Due  to  the  averaging  the  terms  that  involved  sjs2  or  sjsj  will  null. 

This  is  the  error  signal  62-  It  is  passed  through  a  filter  with  the  response  of  and 

thus  W2  obeys  the  differential  equation 

(1  +  =  -9  -t-a^)  -f  l)(u;2  -l-aj) 

+  M2P  (u?i(aju;2  -f  1)  +  ai)(aiU72  -I-  1)) 

The  steady  state  response  will  be 


NiP  (^1(^2  ^2)  +  ^)(^2  +  <12)  +  l52p  (u;j(aju;2 -I- 1) -f  a^)(aiiW2 -i- 1) 

_ 

9 


(28) 


Provided  g  is  chosen  large  enough,  the  right  hand  side  of  (28)  will  be  almost  zero.  This  will 
give  us  the  expected  response  for  W2. 

To  study  the  dynamics  of  (27)  around  the  solution,  W2  =  -02  we  will  linearize  the 
equation.  Let  e  =  W2  +  a2.  We  will  assume  c  small  enough,  so  we  can  disregard  entries  with 

=  -(1  +l^|qip))e-gl^(u;iai(l  -QiQ2)~e  +  u>;a*(l  -aia2)e') 

+<*2  —  ^1-521^  (1  —  aia2)(ai  -t-  u;i(l  —  0102)’) 
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To  obtain  results  on  the  stability  of  (29),  it  can  be  represented  in  vector  form.  The  matrix 
in  this  representation  has  the  following  eigenvalues 


Ai  =  =r(l 


A2  =  ^(1 +5ls2l2|ail2 +^(s2l23l?(u;jaj(l  -  oioj))) 
Aj  is  obviously  always  negative.  Aj  is  also  negative  provided 

1 +<7i^ 


gM 


>  |3f  (u;iaj{l  -  0102)) 


Thus,  the  equation  is  stable  if  u--  is  not  too  small. 

laar 

The  steady  state  response  of  c  is 

+5^2^  IfliH  X  (02  -g|s2P(l  -  aia2)(u;i(l  -  0,02)  +  aj)*) 

+  1^1^2^01(1  -O1O2)’  X  3  (101(02  -y|S2P(l  -0i02)(l0,(l  -  OiOj)  +  Oi)‘))  . 


(30) 


Using  (30)  and  ^  >>  1  we  can  get 


”  a7a7  +  l^2P|aiP)x  (!32p(l  “aia2)(ioi(l  -0103)  +  ai)*) 


(31) 


+j|S2|2oi(l  -0102)*  X  3' (u;i(i32P(l  -Oi02)(lOi(l  -0103)  +ai)*))] 

If  we  now  assume  that  loi  «  we  will  get  that  the  steady  state  e  is  very  small.  Thus 

if  ^  =  u?i  +  <<  1?  (29)  will  become 

RFe  -  RF  W  ((a,(  1  -  ».^e)  = 

|siPe  s:  -i.<2|‘ |1  -  fl,a2p^’ 

From  (32)  it  is  clear  that  |e|  will  get  smaller  with  |6|,  and  will  do  so  in  a  reasonable  pace. 


provided  is  not  too  large. 
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III.  CONCLUSIONS 

Using  the  proposed  model  for  the  weight  controller,  we  obtained  a  differential  equation 
for  the  constcint  p<irt  of  the  first  weight,  from  (14) 

=  -  (1  +  2gtiG)w^  -  2jgn{w^iiW^^w^’ 

-  2gn  [(uj2  +  a2)*|5il^  +  ai(l  +  aiu;2)‘|52P] 

where,  G  =  |u;2  +  a2n5i|^  +  [1  +  aiiW2pis2P,  wf  is  the  dither  sequence  added  to  the 
weight,  and  (•,  •)  denotes  the  time  average  of  the  product. 

For  the  weight  we  examined  its  behavior  in  the  vicinity  of  its  steady  state.  W2  =  —02- 
By  letting  e  =  W2  +  02,  and  assuming  e  «  1,  we  showed  that  c(t)  is  controlled  by  the 
following  differential  equation  (29) 

ri£=  -  (l+s(RP  +  W5|«,|’))« 

-  25'|s2Pii;i3i(ai(l  -  aia2)'‘e) 

+  02  -5|52P(1  -aia2)(aj  +  u;j(l  -0102)") 

Studying  the  differential  equations  in  (14)  and  (29)  we  obtained  the  conditions  for  con¬ 
vergence  in  the  mean  of  the  weights  and  their  steady  state  values.  We  also  studied  the 
sensitivity  of  the  quality  of  separation  to  the  power  of  the  dither  and  other  system  parame¬ 
ters. 
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Figure  1  A  diagram  of  the  Forward/Backward  bootstrap  blind  signal  separator  with 

dither  control. 
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APPENDIX  E 

SIMULTANEOUS  SPATIAL  SEPARATION  AND 
DIRECTION-OF-ARIUVAL  ESTIMATION  OF 
WIDEBAND  SOURCES  USING 
BOOTSTRAPPED  ALGORITHMS  ‘ 


by 


Hagit  Messer  and  Yeheskel  Bar-Ness 


ABSTRACT 


This  paper  presents  two  versions  of  a  novel  adaptive  adgorithm  for  simultaneous  spatial 
separation  and  direction  finding  of  two  wideband,  uncorrelated  sources  received  by  two 
separated  sensors.  The  algorithm  provides  estimates  of  the  sources  (direction  of  arrival  - 
DOA)  and  outputs  two  signals  which  are  filtered  versions  of  the  source  signals.  VVe  describe 
the  different  configurations  of  the  separation  system  and  study  sensitivity  of  the  two  signal 
estimates  to  the  accuracy  in  estimating  the  DOA  of  the  sources.  We  show  that  perfect 
separation  is  achieved  even  if  the  DO  As  are  not  perfectly  estimated,  at  the  cost  of  degradation 
in  the  output  signal-to-noise-ratio.  Then  we  propose  implementation  of  an  adaptive  control 
algorithm  and  we  discuss  the  steady  state  performance  in  the  presence  of  an  additive  noise. 
We  compare  the  complexity,  performance  and  noise  immunity  of  the  two  versions  of  the 
proposed  algorithm. 


‘This  work  was  partially  supported  by  a  grant  from  Rome  Air  Force  Lab,  (AFSC),  Griffis  .Air  Force  Base. 
N.Y.,  under  contract  F30602-88-D-0025,  project  E-21-T49,  Task  C-2-2404. 
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I.  INTRODUCTION 

Fig.  1  describes  the  scenario  where  two  sources  are  received  by  an  array  of  two  sensors. 
The  outputs  of  the  two  sensors  axe: 

zi(t)  =  Si{t  —  Di)  +  —  D2) ei{t) 

22(0  =  S\{t  +  Dx)  +  S2{t  D2)  e2(t)  (1) 

where  si(f)  and  S2(0  ^xe  the  signals  radiated  from  the  1st  and  2nd  sources  respectively.  ei{t) 
and  e2{t)  axe  the  additive  noise  processes  in  each  of  the  sensors  and  D,  is  given  by, 

Di  =  ^sm$i  2  =  1,2  (2) 

2c 

d  is  the  distance  between  the  sensors,  c  is  the  propagation  velocity  and  .2  =  1.2  is  the 
bearing  of  the  2th  source.  We  assume  that  the  random  signals  si(0.  •*2(0'  ci(0  ^2(0 
are  mutually  statistically  uncorrelated. 

In  this  paper  we  present  adaptive  systems  which  receive  xjlO  and  22(0  at  the  input, 
deliver  as  output  signals  y\{t)  —  Si{t)  and  y2(0  =  ^2(0'  and  simultaneously  provide  the 
estimates  of  Di  and  D2  from  which  the  bearings  of  the  two  signals  di  and  62  can  be  derived. 
However,  in  order  to  enable  separation,  some  information  (statistical  or  physical)  about  the 
signals  si(0  and  32(0  **  required.  This  information  will  be  utilized  in  the  design  of  the 
control  loop.  It  enables  initiation  of  the  separation  procedure.  If  further  information  is 
available  (such  as  knowledge,  for  example,  of  one  of  the  two  bearings)  the  same  algorithm, 
which  then  bootstraps  itself,  will  result  in  performance  improvement. 

In  fact,  the  model  described  in  this  paper  is  applicable  to  many  communication  and 
signad  processing  problems  which  can  be  put  in  three  groups:  bearing  estimation  (source 
localization),  source  separation,  and  interference  cancellation. 

•  For  bearing  estimation  (source  localization)  one  is  interested  in  Di  and  02  and  not  in 
the  signal  estimates  si(t)  and  S2{t).  In  this  application,  particularly  in  active  radar  or 
sonar,  much  is  known  about  3i(t)  and  32(0- 
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•  For  source  separation,  the  objective  is  to  get  the  cleanest  possible  version  of  Si(t)  and 
s-iit),  while  Di  «ind  D2  are  nuisance  parameters.  Indeed,  in  some  cases  there  is  some 
prior  knowledge  about  and  62  which  can  be  used  to  restrict  the  possible  values  of 
Di  and  D2. 

•  For  interference  cancellation,  the  objective  is  to  get  a  clean  replica  of  one  of  the  signals, 
say  ai{t)  while  the  other  signal,  as  well  «is  D\  and  D2  are  nuisance  parameters  which, 
in  some  applications,  are  partially  known. 

If  the  signals  Si{t)  and  S2(t)  are  narrowband  signals,  centered  around  a  known  u,o,  then 
a  complex  envelope  notation  can  be  used  and  Eq.  ( 1 )  can  be  written  as 

-1  =  e--'‘-“^'si  +  e-'““^^S2  +  ei 

^2  =  +  C2  (3) 

so  the  unknown  model  parameters  are  represented  by  the  complex  constant  an  =  exj>{  —jusoDi). 
ai2  =  exp(-ju;oI>2)i  <*21  =  =  exp(ju;oi?i)  and  022  =  ajj  =  e.xp(ju;oI>2)-  Eq.  (3)  can 

then  be  written  in  a  matrix  form:  z  =  As+^,  where  >1  is  a  matrix  which  is  a  function  of  two 
unknown  complex  parameters.  The  lineju'  separation  problem  resulting  from  (3)  was  studied 
and  discussed  in  many  papers[l-5]  and  bootstrapped  algorithms,  similar  to  those  proposed 
in  this  paper,  were  shown  to  be  useful  in  its  solution.  However,  such  problem  formalization 
is  not  applicable  for  wideband  signal  environment,  where  Eq.  (3)  is  no  longer  a  proper  rep¬ 
resentation  of  Eq.  (1).  In  such  a  case,  the  received  signals  are  not  a  linear  function  of  the 
unknown  model  parameters,  and  the  model  is  inherently  non-linear.  We  will  show  that  the 
bootstrapped  principle  used  in  narrowband  signed  separation  can  be  adapted  to  solve  the 
wideband  separation  problem. 

The  wideband  DO  A  estimation  problem,  that  is  of  estimating  Di  and  D2  in  Eq.  (1), 
has  attracted  many  research  efforts  in  the  last  decade  or  so.  Different  algorithms  for  DO  A 
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estimation  were  proposed,  very  few  of  them  are  adaptive.  However,  the  estimation  of  the 
source  signals  is  rairely  considered.  Our  proposed  algorithm  cam  be  regatrded  as  an  adaptive 
wideband  DO  A  estimation  algorithm  as  well  as  a  signal  separator  and,  in  particular,  a 
wideband  interference  canceller 

The  paper  is  organized  as  follows:  We  first  study  the  different  bootstrapped  configu¬ 
rations,  we  discuss  the  topology  of  possible  two-inputs  two-outputs  linear  systems  which 
contain  variable  delay  lines  and  summers  only,  and  we  present  two  configurations  for  which 
separation  of  the  signals  S\{t)  and  is  achieved  if  and  only  if  the  variable  delays  equal 
Di  and  D2  of  Eq.  (1).  In  Section  3  we  study  the  sensitivity  of  these  two  structures  to  the 
deviation  of  the  variable  delays  from  the  desired  solution.  We  present  a  small-errors  analysis 
of  the  second  order  statistics  of  the  outputs,  which  shows  the  separation  performance  of  the 
adaptive  algorithm  in  a  tracking  mode  of  operation.  We  prove  that  with  both  configurations 
source  separation  is  guaranteed  in  this  mode  of  operation.  Section  4  discuss  the  adaptive 
algorithm  from  the  theoretical  and  practical  points  of  view.  We  show  that  if  the  two  signals 
to  be  separated  do  not  have  exactly  the  same  spectrum,  then  the  algorithm  converges  to  a 
state  of  total  signal  separation  with  only  ambiguity  in  assigning  an  output  to  a  signal.  We 
also  discuss  the  effect  of  additive  noise  on  the  steady-state  performance  of  the  proposed  two 
versions  of  the  algorithm.  Section  5  presents  a  comparison  of  the  two  configurations  of  the 
bootstrapped  algorithms,  draws  guidelines  for  the  question  of  when  to  use  each  of  them,  and 
empheisizes  differences  between  the  proposed  algorithm  and  the  one  developed  for  narrow- 
band  sources.  Important  issues  such  as  stability  of  the  algorithm,  rate  of  convergence,  etc. 
are  studied  in  an  ongoing  research. 
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11.  THE  DIFFERENT  CONFIGURATIONS  OF  THE  DELAY  CONTROL 


SEPARATION  ALGORITHMS 


We  suggest  that  the  delay- control  separation  system  consists  of  pure  delay  lines  and 
summation  devices  only.  In  the  steady  state  the  delays  in  this  system  are  the  estimates 
of  the  delays  in  the  mixing  models  (Eq.  (1));  that  is  r,  =  Di  :  T2  =  Dz-  The  outputs 
of  the  system,  y\{t)  and  yjiOi  3je  used  to  control  the  delays  and  r2,  following  certain 
optimization  criteria. 

The  frequency-domain  mixing  model  of  Eq.  (1)  can  be  described  by  the  matrix 


M(u;) 


func(Di,  Do) 


(4) 


In  open  loop,  the  separation  system  is  a  linear  system  having  the  transfer  function  matrix 


H(a;) 


=  func(ri,  T2) 


(5) 


Now,  since 


yi(u;)  =  H(w)Z(u;)  =  H(u;)[M(u;)5(u;)  -I-  £(u;)]  (6) 

then  perfect  separation  of  the  signals  si{t)  and  S2(t)  is  achieved  if  the  matrix  T(u;)  = 
H(u;)M(u;)  is  a  diagonal  matrix. 

If  narrowband  signals  are  assumed  (such  that  the  model  of  Eq.  (.3)  is  valid),  three  different 
bootstrapped  separation  structures  can  be  used  [2|.  These  structures  are  the  backward- 
backward  {BB)  configuration,  the  forward- forward  (FF)  configuration,  and  the  backward- 
forward  {BF)  configuration  [3].  When  adapting  the  bootstrapped  principles  to  the  wideband 
case  we  found  that  the  BF  scheme  must  be  excluded,  if  the  filters  and  Hiiu)  (see 

Fig.  Al)  are  required  to  be  pure  delay  lines  (see  appendix  .4). 

The  BB  structure  discussed  in  this  paper  is  a  special  case  of  a  feedback  topology  structure 
introduced  in  [4]  for  separation  on  N  source  signals  using  an  array  of  .VI  >  :V  sensors.  It  is 
shown  there,  that  this  structure  is  a  feedback  implementation  of  the  least-squares  estimates 
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of  the  source  signals,  if  the  direction  of  arrivals  of  the  sources  are  perfectly  known.  This 
paper  considers  the  specicil  case  where  M  =  N  —  2.  However,  its  results  for  the  BB 
configuration  based  on  the  topology  presented  in  [4]  and  the  control  algorithm  of  section  5 
can  be  generailized  to  auiy  M  >  N.  The  generalization  of  the  FF  configuration  is  still  to  be 
studied. 

For  the  two  separation  structures,  the  backward /backward  and  the  forward /forward,  we 
first  find  the  transfer  function  matrix  H(u;)  and  use  it  to  exhibit  the  output  power  spectrum 
matrix,  and  its  properties.  From  [6], 

S^j,(u;)  =  H(aj)S„(u;)H-(u;)  =  T(-;)S„(u;)T-(u,-)  +  H(u;)S„(^)H*(^)  (7) 

where  T(u;)  =  H(u;)M(u;)  is  the  transfer  function  matrix  between  the  signals  to  be  separated 
and  their  estimates. 


2.1  The  Backward-Backward  Configuration 

Fig.  2.a  depicts  the  basic  structure  of  the  BB  configuration.  The  transfer  function  matrix 
of  this  system  is  given  by: 


H8fl(u;)  = 


j 

2sinu;(ri  —  tj) 


Using  Eq.  (4)  we  have 


(8) 


Tss(‘*') 


Hbb(u;)M(u;) 


sinvi.-(Di  —  To) 
sinwfri  —  T2)  [  sinu;(ri  -  Di) 


sina;(Z?2  —  *2) 
sinu;(ri  —  Do) 


(9) 


From  Eq.  (9)  (and  Eq.  (6))  it  is  easy  to  see  that  if  Ti  =  Di  and  T2  =  Dj,  then  Tbb(uj)  =  I  and 
a  perfect  separation  of  the  signal  is  achieved.  The  output  signals  are  then  yi{t)  =  Si(t)-\-hi(t) 
and  1/2(0  =  52(0  +  ^2(0  i  where  ni(f)  and  n2(0  contain  no  signal  components. 

The  system  of  Fig.  2.b  is  exactly  equivalent  to  that  of  Fig.  2.a.  However,  if  one  can 
tolerate  the  outputs  to  be  a  delayed  versions  of  the  signals  to  be  separated,  yi{t)  and  1/2(0 
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can  be  regarded  as  the  outputs  of  separation  system,  which  is  somewhat  less  complex  than 
that  of  Fig.  2.b.  For  the  system  of  Fig.  2.a,  the  transfer  function  matrix  between  z  and  y  is 
given  by, 

HflsM  =  ^ ‘ 

— 2j  sinu;(ri  —  Tj)  [  — e-'  1 

j  ’  _g-Jw(Tl+Tj) 

2sinu;(ri  -r2)  e-jw(T,-r5) 

and 


Tbb(uj)  =  Ha8(‘*')M(u ,  = 


_ 1 _  e  sinu;(Z?i  —  r2)  e'-'"’’’  sin.i;(£>2  —  r^) 

sina;(ri  —  r2)  sinu;(ri  —  Di)  e-''*'’’*  sinu;(ri  —  Z)^) 


Taslw)  is  a  diagonal  matrix  for  ri  =  £)x  and  T2  =  Z)^,  but  it  is  no  longer  the  identity  matrix. 


.\ssuming  that  the  signals  to  be  separated  are  uncorrelated,  wide  sense  stationary  ( VV'55) 
processes  with  power  spectral  density  {PSD)  Si(uj)  and  52(u;),  respectively,  the  PSD  matrix 
of  the  outputs  of  the  BB  configuration  is  given  by; 


sinu;(ri— r2)  '  **  sinw(Ti— r2)  f 

Sbs(u?)  ^  ,  sin w( Ti—Pj)  sin itj{ Pi  — t; ) 

'  sinu<(Ti— Tj)  sinw(r]— rj) 

I  ^  /  \3inw(D2-T2)  3inu/(T, -Q.;) 

•  '  siiiw(Ti— Tj)  sinu;(ri— Tj) 


5"  ^  sinu<(Di  -r; ) 

'sinu/(Ti-T^)  sinu/(Tj-r2) 

,  sinw(ri-02) 

^  sin  ti/(  Ti  —  Tj )  sinw(Ti  — r2) 

\2  I  c/  sinwiri-D^) 
sinJ(;,-r2p  +  •^2(-)(7nr:;j7^T777 


_ -^(^) _  1  —  cosu;(ri  —  r2) 

2sin^u;(ri  —  T2)  —  cosu;(ti  —  r2)  1 


Eq.  (12)  is  derived  from  Eq.  (7)  using  Hbb((*^)  and  Tbb(u^)  of  Eqs.  (8)  and  (9).  where  we 
assumed  that  the  noise  processes  are  uncorrelated  and  have  equal  spectra  5^,  (a;)  =  5.^  (u.-)  = 
iV(uj).  It  can  be  shown  that  Sbb(w),  which  is  related  to  Hbb(w)  and  Tsb(<^)  of  Eqs.  (10) 
and  (11)  is  very  similar.  The  only  difference  is  that  the  off-diagonal  terms  are  multiplied  by 

g n+T2)_ 
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(13) 


From  Eq.  (12),  the  output  PSD  at  one  of  the  outputs,  say  yi,  is  given  by, 
c  ^  X  ,,sinu;(A -r2),2  ,  ^  ,  .,,sinu;(£>2  -  t-;)  ;  .V(u;) 

Sy\  (^  )  ”*  *^1  (^ )(  .  y  \  )  “b  *^2\^)\  /  \)'^0*2/  \ 

sinu;(Ti  -  Tj)  sinu;(ri  -  rj)  2sin^u;(ri  -  rj) 

and  a  similar  term  for  the  power  spectral  density  of  the  other  output.  The  cross  spectrum 

between  the  outputs  consist  of  three  terms  each  related,  respectively,  to  the  signals  to  be 

separated,  si(<),  S2(0>  additive  noise.  Note  from  (13)  that  at  the  output.  yi{t) 

the  term  related  to  Si(f),  for  example,  can  be  viewed  as  having  resulted  from  passing  si{t) 

via  a  filter  with  transfer  function  •  This  transfer  function  is  highly  non-linear  in 

the  unknown  parameter(s)  and  their  estimate(s).  Therefore,  edthough  a  pure  delay  line  is 

a  special  case  of  a  linear  filter,  the  problem  discussed  here  is  very  different  from  the  linear 

model  in  [5-7]  and  in  [8],  where  the  unknown  linear  filters  are  assumed  to  be  rational  (  FIR 

or  IIR)  filters  of  unknown  coefficients. 

Also  note  that  the  possibility  of  tx  =  rj  must  be  avoided,  and  that  at  u;  =  0  the  output 
noise  term  diverges.  Therefore,  this  BB  configuration  can  only  be  used  with  band-pass  sig¬ 
nals  that  impinge  on  the  array  from  directions  not  very  close  to  one  another. 


2.2  The  Forward- Forward  Configuration 

Fig.  2.C  depicts  the  basic  structure  of  the  FF  configuration.  The  transfer  function  of  this 
system  is  given  by. 


HFF(t*;) 


gjwrj  _g-jwT2 


=  -2jsinu;(ri  -  rjlHesft*') 


(14) 


Using  Eq.  (4)  we  have. 


Tff(w)  =  Hff(w)M(u;)  =  — 2j 


sinu;(Z?i  —  T2)  sinu?(£)2  —  T2) 
sinu;(ri  —  D\)  sinu;(ri  —  D2) 


-2j  sinu;(ri-r2)TBs(u,') 
(15) 


Note  again  that  if  tx  —  Dx,  T2  =  D2  the  two  signals  are  indeed  separated.  However,  each 
of  the  two  outputs  rather  than  being  a  delayed  version  of  the  corresponding  input,  consists 


of  superposition  of  delayed  versions  of  the  separated  inputs.  In  fact,  yi(t)  =  Si{t  —  A)  — 
si(t  +  A)  +  ni(t)  and  y^it)  =  S2{t  —  A)  —  S2{t  +  A)  +  n2{t),  where  A  =  —  Dj  and  hi(<) 

and  n2{t)  contain  no  signal  components.  Thus  the  separated  outputs  are  distorted  versions 
of  the  input  signals,  amd  for  applications  where  such  a  distortion  cannot  be  accepted,  the 
BB  configuration  should  be  used.  On  the  other  hand,  if  the  signals’  waveforms  are  nuisance 
parameters  cind  one  is  mostly  interested  in  the  unknown  delays  Di  and  D2,  then  the  FF 
configuration  of  Fig.  2.c,  or  its  equivalent  simpler  version  Fig.  2.d  can  be  used.  In  the 
system  of  Fig.  2.d,  the  outputs  yi(t)  and  y2{t)  decouple  the  inputs  if  Di  —  Tj  and  D2  =  T2, 
so  yi{t)  contains  no  part  of  S2(<)  and  y2{t)  contains  no  part  of  Si{t).  Both  outputs,  however, 
contain  distorted  versions  of  the  decoupled  inputs. 

The  power  spectral  density  matrix  for  the  FF  configuration  is  given  by  (see  Eq.  (7)). 
From  Fig.  2.c, 


SrF(w) 


S\{u})  s\n^  u}{D\  —  T2) 

+  53(0;)  sin^  u}{D2  —  T2) 

Si(u;)sinu;(ri  -  Di)sinu;(Di  -  T2) 

+  S2{uj)  sinuj{D2  —  r2)sint<;(ri  —  D2} 


5t(u;)sinu;(ri  —  D\)smu;{Di  -  T2) 

+  53(0;) sin u;(Z)2  -  r3)sinu;(ri  —  D2) 

Si{uj)  sin^  uj(Di  -  Ti) 

+  52(u;)sin^>*;(ri  —  D2) 


+  2Niuj) 


1  —  cosu;(ri  —  r2) 

costi;(ri  —  r3)  1 


=  4sin^u;(ri  -  r2)Ss5(u;) 


(16) 


By  comparing  (16)  with  (12)  we  notice  that  the  power  spectrum  and  cross  spectrum  of  the 
outputs  of  the  BB  and  FF  configurations  differ  only  by  4sin^u;(Ti  —  T2).  The  FF  config¬ 
uration  can  be  regarded  as  containing  zeros-only,  or  FIR  system,  while  the  BB  has  poles 
and  zeros,  or  HR  system.  As  such,  the  FF  configuration  can  handle  low-pass  signals  too. 
and  is  not  sensitive  to  situations  where  n  =  T2.  Also  notice  that  the  BB  configuration  can 
be  looked  upon  as  an  FF  configuration,  followed  by  a  2  x  2  system  with  a  transfer  function 
4sin^'jhi-T2)^’  where  /  is  the  2-dimensional  identity  matrix. 
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III.  SMALL-ERRORS  ANALYSIS  OF  THE  OUTPUT  SPECTRUM 


In  both  FF  amd  BB  structures,  ti  =  Di  and  rj  =  D2  result  in  perfect  separation  of  the 
source  signal.  If  D\  and  D2  are  unknown,  they  should  be  estimated.  To  study  the  effect  of  the 
estimation  errors  on  the  separation  performance  of  the  two  configurations  we  ne.xt  find  the 
cross-spectrum  of  the  outputs  under  small  error  assumption;  (i.e.,  IV'.I  =  |r,  —  £),|  «  lAI, 
1  =  1,2). 


3.1  The  Output  Power  Spectral  Density  Matrix 

We  look  at  the  linear  approximation  of  the  output  power  spectral  density  matrix,  i.e.; 

O  /  N  O  /  N  I  .  ,  f^Sy(u;)  ,  ,  ,  ,  r^Syfu;)  ,  , 

Sy(a;)  —  Sy(a;)  I0,  =t^=ol  +  ^/’2[  lv,=w2=oj  (1') 

where  ri'\  =  Tx  —  D\  ,and  02  =  ^2  ~  ^2  are  sufficiently  small. 

From  Appendix  B  we  know  that  the  linear  approximation  of  Eq.  (12)  is 


-f- 


;V(u;) 


2  sin  (w A) 


1  -I- 


2m_ 


tg{ui^) 


(-01  +  02) 


-I- 


sin(u>n) 


—  cos(u;A) 

(1  -I-  cos^(u;A))(-0i  -t-  1D2) 


—  cosfwA) 

+  +<^°s2(u;A))(-»i;i  +1^-2) 


(18) 


where  A  =  Z^i  —  D2-  Similarly,  for  the  FF  configuration,  applying  Eq.  (17)  on  Eq.  (  16) 
yields  (see  Appendix  B): 

r  Si(u;)[sin^(u/A)  —  02u;sin2(u;A)]  u;sin(u;A)(0i5i(u;)  —  0252(w’))  1 


Sff{u))  s£  4 


u;sin(u;A)(0i5i(u;)  —  0252(4*;))  S2(u;)[sin^(u;A)  -I-  a’iu;sin2(u;A)] 


-H  2iV(u;) 


1 

(01  —  02)4*;sin(4*;A)  —  cos(u;A) 


(01  —  02)4*;  sin(u;A)  ~  cosfcjA) 
1 


(19) 
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Note  that  for  both  configurations,  sm2Lll  errors  in  the  estimates  of  Di  and  of  D2,  such  that 
1^1  0, 1^1  Rs  0  but  not  identically  zero,  still  guarantee  separation  of  the  two  signals.  The 

power  spectral  density  of  each  of  the  outputs  (diagonal  elements  in  (18)  or  ( 19))  contains  a 
filtered  version  of  only  one  of  he  signals  (plus  noise). 

From  Eqs.  (18)  and  (19)  we  notice  that; 

1.  For  =  ti>2  =  0  the  signals  si{t)  and  S2{t)  axe  separated  so  that  at  yi{t)  we  have  no 

component  of  S2(t)  and  at  y2(0  we  have  no  component  of  This  holds  in  both 

configurations  and  is  still  true  if  as  0  and  1P2  *=  0.  However  while  for  =  t’2  =  0 
the  output  of  the  BB  configuration  consists  of  an  exact  replica  of  the  input  signal,  for 
iPi  as  0  and  W2  ^  this  separated  signal  is  a  filtered,  distorted  replica  of  the  input 
signal.  For  the  FF  configuration  the  output  signal  is  a  filtered  version  of  the  input, 
when  01  and  02  3xe  almost  zero  (small  errors)  or  exactly  zero. 

2.  If  N{u})  =  0  (no  additive  noise),  then  =  02  ==  0  guaramtee  uncorrelated  outputs 

0  iti  both  configurations).  If  neither  rpi  nor  1V2  is  zero  the  outputs  are.  in 
general,  correlated. 

3.  In  the  presence  of  noise,  the  outputs  are  correlated  even  if  Wi  =  V2  =  0- 


3.2  The  Output  SNR 

With  perfect  delay  estimation;  xpi  =  u;2  =  0,  the  output  signal-to  noise  ratios  for  the  two 
structures  are  given,  respectively,  by 


SNRf®  = 


fw  Si(uj)du> 


2 (u/A)  ^ 


Sj^rFF  _  2  /ty  Si(u>)  sin^(u;A)du; 

!w  N(u;)duj 
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where  W  is  the  processing  bimdwidth.  The  inputs  SNR  are  given  by; 


snr:,= 


iw  Si{u)du 


1  =  1,2 


(22) 


/jy  N{(jj)<Lj 

We  notice  that  for  both  configurations,  the  cancellation  of  the  other  signal  (interference) 
causes  degradation  in  the  SNR  — the  output  SNR  is  worse  than  the  input  SNR  (but, 
hopefully  better  than  the  input  SINR  -  the  sign2J  to  interference  plus  noise  ratio!).  From 
Eqs.  (20)  and  (21)  we  see  that  is  A  =  Dx  -  is  smaller  (the  spatial  separation  between 
the  sources  is  smaller),  the  output  SNR  is  smaller.  Notice,  however,  that  the  output  SNR 
is  different  for  the  two  configurations. 

For  the  case  of  flat  spectral  density,  5,(u>)  =  Pi  and  N{uj)  =  P\  over  -.’o  —  W/2  <  |u;|  < 
ujQ  +  1^/2,  we  have  for  the  inputs  SNR,  SNRi  =  -^  =  pi,  i  =  1,2  and  for  the  outputs  SNR 
is  (see  Appendix  C), 

2piW  pi(cos  AW  —  cos  2u;o) 


SNRf®  = 


^  sm^(wA) 


f  =  l,2 


(23) 


SNRJ^  =  sin^(u;A)du/ =  p,(1  -  cos2u;oA 


sin  WA 
WA 


) 


1  =  1.2  (24) 


Notice  that  if  W  -C  wq  (a  narrowband  assumption),  Eqs.  (20)  and  (21)  yield. 


sin*' 


fF  ^  25i(u;o)sin^u;oA 


SNR: 


0^ 


N{u;o) 


=>  SNR"  =  SNRj®  =  2sin^u;oASNR;„  ;  i  =  1.2 


(25) 


That  is,  under  perfect  sep2U'ation  and  narrowband  aissumption,  the  outputs  SN  Ris  the  same 
for  the  two  configurations,  while,  as  can  be  seen  from  Eqs.  (23)  tmd  (24),  in  the  wideband 
case  it  can  be  very  much  different.  Also  notice  that  in  the  narrowband  case,  the  outputs 
SNR  satisfies  SNRo,  =  7SNRJ,j  where  0  <  7  <  0.5,  so  the  SNR  degradation  is,  at  least  3 
dB.  In  the  wideband  case,  depending  on  the  relative  bandwidth,  the  maximum  degradation 
in  SNR  can  be  smaller.  Clearly,  due  to  the  perfect  CMcellation  of  the  other  signal  at  each  of 
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the  outputs,  the  outputs  SNR  are  the  same  as  the  output  signal-to-interference-plus-noise- 
ratio  {SINR).  Eqs.  (23)-(25)  show  that  the  outputs  SINR  is  a  function  of  the  input  SNR 
(not  the  input  SINR,  which  is  smaller)  and  of  the  weighted  spatial  separation  between  the 
sources.  A. 

As  suggested  by  Eqs.  (18)  and  (19),  the  output  SNR  in  a  ‘‘small  errors"  scenario,  i.e.. 
Vi  ^  0  «md  ^  O',  axe  different  from  those  obtained  with  no  errors  (p\  =  =  0).  even 

though  in  both  cases  the  signal-to-interference  ratio  (SIR)  in  the  two  outputs  are  infinite 
(perfect  separation). 

The  important  conclusion  from  this  subsection  is  that  when  signal  separation  is  achieved, 
the  ■‘cost”  in  degrading  the  output  SNR  can  be  severe.  Unless  the  other  signal  ( the  interfer¬ 
ence)  input  SNR  'is  high,  it  is  not  guaranteed  that  the  output  SNR  is  indeed  larger  than  the 
input  SINR  (signal  to  interference  +  noise  ratio),  even  in  the  ideal  case  where  c’l  =  V2  =  0. 

rv.  OPTIMIZATION  CRITERIA  AND  SEPARATION  ADAPTIVE 
ALGORITHMS 

.A  signal  separation  problem  similar  to  the  one  addressed  in  this  paper,  and  which  is 
highly  related  to  a  multi-channel  identification  problem,  is  widely  considered  lately  under 
different  names  and/or  scenarios  (e.g.  (8)).  Most  optimization  criteria  used  for  controlling 
the  algorithms  are  related  to  the  aissumptions  that  the  signals  to  be  separated  are  statistically 
independent  and  that  at  least  one  of  them  is  a  non-Gaussian  process[5-7].  Based  on  these 
assumptions  a  family  of  higher-order  spectra  (HOS)  optimization  criteria  are  proposed.  The 
spatial  separation  problem  addressed  in  the  present  paper  is  often  related  to  cases  where  the 
signals  to  be  separated  are  both  Gaussian  (e.g.,  passive  localization  in  sonar).  The  signals 
can  be  assumed  uncorrelated  (or  statistically  independent)  but  no  higher-order  cumulants  (or 
spectrum)  can  be  used  as  optimization  criteria.  Decorrelation  of  the  output  signals,  which  is 
indeed  a  necessary  condition  for  separation  when  no  additive  noise  is  present,  can  be  used  as 
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an  optimization  criterion.  In  the  sequel,  we  study  how  outputs'  decorrelation  can  be  made 


&  sufficient  condition  for  source  separation  in  our  problem.  This  is  a  special  case  of  [8].  in 
which  the  outputs’  decorrelation  criterion  was  used  for  any  linear-filtered  combination  of  the 
two  signals.  However,  the  case  we  study,  where  the  combination  filters  are  pure  delay  lines, 
is  of  special  interest  because  of  the  related  applications.  Also,  the  non-linear  dependencies  of 
the  filter(s)  on  the  unknown  parameter(s)  r  make  the  use  of  existing  results  in  our  problem, 
far  from  being  trivial. 

Assuming  that  the  inputs  aie  zero-mean  processes,  that  no-noise  is  present  (*V(u;)  =  0), 
and  that  ri  ^  r^,  then  from  Eq.  (12)  or  (16)  we  conclude  that  for  both  BB  and  FF 
configurations  the  output  signals  are  decorrelated  if  and  only  if 

5i(u;)sinu;V’i  3inu;(A  —  02)  ~  •!52(w)sinu;ty2sinu;(A -I- it’i)  :  Vu;  (26) 

It  is  simple  to  note  that  (26)  will  be  satisfied  for  every  u;  and  hence  the  outputs  will  be 
decorrelated  if  0i  =  02  =  0-  On  the  other  hand  if  0i  ^  0  and  ii^2  ^  0  we  want  to  find 
conditions  under  which  this  equation  is  satisfied,  for  any  a;. 

With  the  small  errors  approximation  of  Eq.  (18)  or  (19),  we  get,  instead  of  Eq.  (26)  : 

0i5i(u;)  =  0252(u;)  (27) 

Since  rpi  and  W2  are  to  be  constants  (in  the  steady  state  of  any  algorithm).  Eq.  (27)  is 
satisfied  for  0i  0,  V'j  ^  0  if  and  only  if  5i(u;)  =  q52(u;).  That  is  : 

If  the  signals  have  the  same  spectral  shape,  the  outputs  can  be  decorrelated  with 
xpx  and  02  being  non-zero,  but  small,  only  »/0i/02  =  l/pu,  Pu  being  the  power 
ratio  between  the  signal  si{t)  and  the  signal  S2{t). 

If  5t(u;)  ^  aS2(u;),  the  only  solution  to  Eq.  (27)  for  every  u;  is  =  ii'2  =  0.  Thus,  we 
conclude  that,  at  a  small  error  scenario,  then  if  the  input  spectra  are  of  different  shape  (and 
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that  *V(u;)  =  0).  a  necessary  anH  sufficient  condition  for  =  0  and  1^2  —  0  is  decorrelation 
of  the  output  signal. 

Is  this  result  valid  also  if  no  small-errors  assumption  is  used?  Given  that  5i(u;)  ^  q52(u;), 
then  beside  =  02  =  0  (26)  is  satisfied  only  if 

1.  01  =  0,  02  0  and  A  =  —01  =  0  which  is  equivalent  to  D\  =  D^- 

2.  %'\  =  0,  02  ^  0  and  A  =  0i  =  0  which  is  again  equivalent  to  D\  =  £>2- 

3.  A  -I-  01  =  0,  A  -  02  #  0  which  is  equivalent  to  A  =  02  =  —V\-  This  condition  leads 

to  Ti  =  D-i  and  r2  =  Di.  That  is,  signad  sepairation  in  the  opposite  direction  (yi(0  is 

proportionad  to  S2{t)  and  y^it)  is  proportionad  to  si(<)). 

This  ambiguity  is  inherent  in  the  model  identification  problem[e.g.,  8]. 

Thtis,  a  proper  criterion  for  separation  of  two  uncorrelated  Gaussian  signals  of 
different  spectra  is  decorrelation  of  the  separation  outputs. 

If  the  signals  have  the  same  spectral  shape  (so  5i(u;)  =  q52(u;)),  a  discriminator,  which 
exploit  slight  prior  information  about  distinuishability  of  the  signals  to  be  separated,  can  be 
used  to  trigger  the  algorithm  as  suggested  in  [l]  for  narrowband  signals. 

4.1  Decorrelation  Algorithm 

Decorrelation  can  be  performed  both  in  frequency  domain  (imposing  5y,yj(w)  =  O.Vu,-) 
or  in  the  correlation-lag  (time)  domain  (  imposing  /2y,yj(Q)  =  O.Vq)^.  Because  of  availabil¬ 
ity  of  hardware  components,  we  are  interested  in  time  domain  algorithms.  The  algorithm 
adaptively  controls  Ti  and  T2  to  reach  of  outputs  decorrelation.  That  is,  we  need  to  solve  two 
delay  control  equations  simultaneously,  in  order  to  obtain  their  unique  solution  iL'i  =  iV2  =  0. 

^Notice  that  for  the  two  configurations  {BB  ^uld  FF)  the  frequency  domain  requirements  result  in  the 
same  equation,  while  the  time  domain  requirements  are  inherently  different. 
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The  time  domain  decorrelation  criterion  introduces  an  infinite  number  of  equations  in  the 
form: 

-  Oi)}  =  A5,jjQ(ai,Ti,T2)  =  0  -oo<a,  <30  (28) 

(E  stands  for  statistical  expectation).  For  amy  choice  of  Qi  and  02  we  can  solve  simultaneously 


^va(Q‘i;n,i'2)  =  0 

Ryini°‘2;'ruT2)  =  0 


(29) 

(30) 


for  Ti  and  T2.  The  choice  of  01,02  should  be  such  that  Eqs.  (29)  and  (30)  are  linearly 
independent. 

Under  small-errors  conditions  and  no-noise  assumption,  then  using  Eq.  (18)  for  the  BB 
configuration,  Eqs.  (29),  (30)  become: 


01  r  ^ 

J-00  SI 


u;5i(u;) 


sin(u;A) 


-jwai 


du) 


r°°  u 

-02/  - 
Joo  si 


u;52(ci;) 


00  sm(u;A) 


=0 


(31) 


roo 

01  /  - 
J-co  si 


00  sin(u;A) 


/oo  U 

-02  /  - 
J-00  Sl 


°°  u;52(u;) 


00  sin(u;A) 


eJ'^°^du;  =  0 


(32) 


If  Oi  ^  02  then  cos  u;oi  =  cos  uiaj  only  for  discrete  point  of  u)  which  has  a  measure  zero  on  the 
real  aixis  u.  Therefore,  we  have  coswoi  ^  cosu;a2  on  set  of  intervals  with  a  positive  measure, 
and  hence  the  set  of  equations  (31)  and  (30)  are  lineairly  independent.  Finally  we  conclude 
that  if  the  algorithm  brings  the  controlled  delays  to  the  vicinity  of  ipi  =  =  0.  then  the 

algorithm  converges  to  these  values.  Similar  argument  apply  to  the  FF  configuration  and 
equation  (19). 

The  proposed  control  algorithm  is  depicted  in  Fig.  3.  From  which  we  note  that  it  reaches 
a  singular  point  only  if  ^,y2(ai)  =  0  and  similarly  for  r2.  Assuming  that  u;o  is  the  center 
frequency  of  the  processing  bandwidth  we  suggest,  eis  a  rule  of  thumb,  to  choose  =  0  and 


Q2  =  — • 

^  u/O 
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4.2  Practical  implementation  considerations 


1.  Prawrtically,  oi  and  oj  in  Fig.  3  can  be  changed  during  the  adaptation.  The  choice  of 
these  delays  may  have  great  effect  on  the  rate  of  convergence,  even  if  the  steady-state 
values  are  the  same.  This  subject  is  worth  further  investigation. 


2.  For  the  BB  configuration  and  the  narrowband  case,  decorrelation  criterion  can  be 
replaced  by  minimization  of  the  output  powers[3).  In  the  more  general  wideband 
case,  one  can  show  (see  Appendix  D)  that  decorrelation  of  the  outputs  is  a  sufficient 
condition,  but  not  a  necessary  one  for  minimum  power,  so  that  minimum  power  criteria 
can  not  replace  decorrelation.  In  particular,  for  the  delay  control  case  since  the  output 
power  is  given  by, 

^  /.I  1  =  1,2  (33) 

a  necessary  condition  for  minimum  power  is  =  0,  i  ^  j  i,j=1.2  for  which  it  is 
sufficient  to  have: 


(u;)  =  0 


(u;)  =  0 


Vu; 


(.34) 


From  Eq.  (12),  with  N{ui)  =  0,  we  get. 


2uj 

sinu;(Ti  —  T2) 


[Sx(u;) 


sinu;(Ti  -  Di)sinuj{Di  -  r^) 
sinu;(ri  —  r2)  sinu;(ri  —  T2) 


and  similtirly. 


,  ^sma/(£)2  -  r2)smu;(r,  -  £>2), 

+  -’2(‘*/)-: - ^ ; - - 

smu;(ri  -  72)  smw(Ti  -  r2) 


2uj 


sinu;(Ti  —  r2) 


^  c  (  2ti; 

-^5y,yj(w)  =  _. _ — -5y,y,(u;) 


dTi 


sinu;(Ti  —  T2) 


(35) 


(36) 
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We  see  that  imposing  decorrelation  of  the  output  signals  (5yjy,  (w)  =  5y,yj(u;)  =  0,  for 
every  w)  is  equivalent  to  imposing  Eq.  (34).  Using  Eq.  (35)  or  Eq.  (36)  in  Eq.  (33)  we 
have, 


dP,  (-!)•  r 


■duj  ;  i  j  i  =  1.2 


(37) 


^  r 

dTj  IT  7-00  sin  u;(ri  —  Tj) 

Thus,  decorrelation  of  the  outputs,  i.e.,  ^^^^(u;)  =  0  for  all  u,  is  sufficient,  but  not 
necessary,  for  minimum  power.  Therefore,  the  criterion  of  minimum  power  used  in  the 
narrowband  case,  does  not  necessarily  leads  to  the  desired  separation  in  our  case.  [A 
special  case  is  that  when  5yjyj(w)  =  constamt,  i.e.  -  the  cross  spectrum  is  flat  over  the 
frequency  band  of  interest  then  decorrelation  is  a  necessary  and  sufficient  condition  for 
minimum  power]. 


3.  In  practice,  decorrelation  of  the  outputs  yi  and  yj  iii  Figs.  2.b  and/or  2.d  is  sufficient  for 
separation,  and  therefore  these  outputs  can  be  used  as  inputs  to  the  control  algorithm 
of  Fig.  3.  If  one  can  bare  constant  delay  of  the  outputs  then  the  part  of  the  scheme 
which  uses  yi  as  inputs  to  produce  y^  can  be  removed,  resulting  in  a  simpler  separation 
scheme. 


4.  The  optimization  criterion  used  assumes  no  noise  {N{u)  =  0).  However,  the  noise  can 
have  dramatic  effect  on  the  performance  of  the  algorithm  as  in  the  narrowband  case 
[3].  We  discuss  this  effect  under  the  “small  errors”  assumption: 

By  comparing  the  off-diagonal  entries  of  Eqs.  ( 18)  and  ( 19)  we  see  that  at  u’l  ss  0.rv2  ss  0 
the  cross-spectrum  function  of  the  separator  output  is  approximately  zero  for  the  two 
configurations  as  long  as  iV(u;)  =  0  and  sin(u;A)  ^  0.  However,  the  effect  of  the 
additive  noise  is  dramatically  different  for  the  two  schemes.  The  average  cross-power 
noise  for  the  FF  configuration  is  given  by, 

^[2^  = f  2iV’(u;)[cos(u;A) -f  (t/>2  —  »/>i)t*;sin(u;A))]cL;  (38) 

27r  J— 00 
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while  for  the  BB  configuration  it  is  given  by 


f  — ^^!^fl—[cos{uA)  +  (^2  -  'P\)-r-, — ^(1  +  cos^(u.'A)]<L;  (39) 

**  2:r  y-oo  2sin^(wA)^  sin(u;A) 

We  mainly  notice  that  in  the  cases  where  A  is  small  (which  is  related  to  a  “high 

resolution”  scenario)  the  effect  of  the  noise  on  the  performance  of  any  output  is  more 

dramatic  in  the  BB  structure  than  for  the  FF  one.  As  in  the  case  of  narrowband 

signals[3],  the  presence  of  an  additive  noise  causes  bias  to  the  estimates  of  Di  and  Do. 

«  * 

If  we  let  Ti  =  Di  and  T2  =  be  these  estimates; 

ri  =  D,  =  Di+€,  (-10) 

T2  =  D2  —  D2  +  £2  ('ll) 

then  €1  and  €2  are  non-zero  mean  random  processes.  Their  mean  is  proportional  to  the 
average  cross-power  noise  of  Eqs.  (38)  and  (39),  and  is  larger  for  the  BB  configuration 
than  for  the  FF. 

V.  CONCLUSIONS  AND  DISCUSSION 

In  this  paper  we  presented  two  bootstrapped-like  algorithms  for  spatial  separation  of 
wideband  sources.  We  show  that  by  seeking  decorrelation  of  the  outputs  of  either  a  sym¬ 
metric  feedback  or  a  forward  structure  we  achieve  both  separation  of  the  source  signals  and 
estimation  of  their  relative  delays.  An  adaptive  bootstrapped  algorithm  for  such  output 
decorrelation  is  proposed  and  its  pe^form^mce  for  source  separation  is  evaluated  using  a 
small  error  analysis.  We  show  that  if  tracking  is  achieved  (i.e.,  ri  s:  Dj  and  %  D2).  per¬ 
fect  separation  of  the  source  signals  is  performed  at  the  cost  of  increasing  SNR  and  signal 
distortions.  These  distortions  can  be  compensated  for  by  standard  equalization  methods. 
The  effect  of  delay  estimation  errors  caused  by  the  presence  of  additive  noise  at  the  inputs 
is  studied  and  is  shown  to  be  potentially  haurmful. 
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Two  different  configuratioas  of  the  adgorithm,  denoted  hy  BB  for  backward- backward  and 
FF  for  forward- forward,  are  discussed.  While  both  are  able  to  perform  source  separation 
and  delay  estimation,  they  exhibit  several  differences  : 

1.  In  the  ideal  situation,  i.e.,  when  =  02  =  0,  the  BB  configuration  provides  undis¬ 
torted  versions  of  the  signal  waveforms,  while  the  FF  configuration  decouples  the 
signals  but  provides,  at  the  outputs,  a  filtered  version  of  them.  Therefore,  if  an  e.xact 
replica  of  the  source  signal  is  needed,  the  BB  configuration  is  to  be  preferred. 

2.  In  the  presence  of  additive  noise,  the  FF  configuration  provides  better  estimates  of 
the  unknown  source  directions  (the  delays)  than  the  BB  configuration.  Thus,  the  F F 
structure  is  better  for  direction  of  arrival  (DOA)  estimation. 

3.  The  BB  configuration  exhibits  difficulties  in  the  presence  of  noise  when  applied  at 
baseband  (see  (39)). 

In  comparison  to  n2UTOwband  separators  [1-3],  we  conclude  the  following; 

(a)  The  mixed  forward- backward  configuration  [2]  can  only  be  implemented  in  the 
narrowband  case. 

(b)  Unlike  the  narrowband  in  the  broadband  case  decorrelation  cannot  be  replaced  by 
minimization  of  the  output  powers,  when  backward- backward  separator  is  used. 

(c)  If  the  signals  are  only  known  to  be  uncorrelated  and  have  the  same  spectrum, 
then,  as  in  the  narrowband  case,  a  discriminator  is  needed  to  achieve  separation. 
If,  however,  their  spectrum  is  known  to  be  different,  then  such  a  discriminator  is 
unnecessary. 

Further  study  of  the  control  algorithm  under  different  scenarios  is  currently  being  pur¬ 
sued.  .\lso  under  current  examination  is  the  question  of  generalization  of  the  separation 
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algorithm  to  N  inputs  and  M  sensors,  M  >  N.  For  this  it  was  already  shown  in  [4] 
that  the  BB  configuration  can  be  naturally  generalized  and  it  results  in  a  least-square 
estimate  of  the  signal  waveforms.  The  generalization  of  the  FF  configuration  and  of 
the  control  algorithms  is  still  ongoing. 


or 


gjw(Di-D2)  ^ 

1  -  “  g-jw(Di-D2)  _  eMDi-Di)  ~  -2;  sinu;(Di  -  Dz) 

j _ 

2sinu;(Di  -  D^) 


.Notice  that  Hxiu)  can  not  be  implemented  by  a  simple  pure  delay  line,  so  the  FB  structure 
cannot  be  considered  if  this  constraint  is  valid. 
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Appendix  B 

From  Eq.  (16), 


Sff(w)  =  4 


Si{u})sia^  uj{P\  —  Tj) 

+  S^iuj)  sin^u;(D2  —  ^2) 

Si(u;)smw(ri  -  Di) sin uj{Di  -  tj) 

+  52(0;)  sin uj(D2  -  r2)sinu>(T,  -  D2) 


Si(u;)sinu;(Ti  —  D\)sinu;{D\  — 
+  S2(u/)sinu;(Z)2  -  r2)sinwj(Ti  - 


Si(u>)sin^u;(Ti  —  Di) 

+  82(1^)  sin^ -  D2) 


+  2N{u) 


—  cosu;(ri  —  r2) 


—  COStij(Ti  —  T2) 


Thus 


lwi=ti^=0  - 


45,  (w)  sin^(u;A)  +  2iV(w)  -2JV(a;)  cos(u;A) 
-2iV(w)  cos(u;A)  4S2(u;)  sin^{u?A)  +  2,/V(u;) 


■5,(u>)  0  ]  r  1  -cos(u;A) 

=  4sin^(u;A)  +2iV'(u;) 

0  S2(u;)  L  -cos(u;A)  1 


(B-1) 


From  Eq.  (B-1) 


^Sff(u;) 

ar. 


0  u;cosu;(ri  —  £?i)sinu;(Di  —  r2)5,(u.) 

-t-u;smu;(I>2  -  r2)cos«;(ri  -  £)2)52(u.-) 

a;cosu;(T,  -  £»,) smu;(£>i  -  r2)5,(u;)  2u;sinu;(Ti  -  Di)cosuj{n  -  Di)Siy  ) 
+ujsinuj{D2  —  r2)cosu;(ri  —  D2)S2{^)  -l-2wsinu;(ri  —  £)2)cosa;(ri  —  D2)S2{^') 


-t-  2N{u) 


u;sinu;(Ti  —  T2) 


u;sinu;(Ti  —  r2) 


(B-3^ 


5Sff(‘^) 


ivj=wj=o  “  4 


0  u;sin(u;A)5,(u;) 

u;  sin(u;A)S,(a;)  2uj sin(u;A)  cos(u;A)52(u;) 
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+  2.V(u;) 


0  u;sin(u;A) 
a;sin(u;A)  0 


(B-4) 


Also ' 


dr^ 


=  4 


I  ~a£srs.;  -°S:S :  S . 

-u;Si(u;)siiiu;(ri  -  Di)cosu;(Di  -  ^ 

-u;52lu;)cosu;(D2  -  r2)smu;(T,  -  D2) 


+  2iV(u;) 


0  — u;sin(u;(ri  —  T2))  "j 

— u;sin(u;(ri  — 


iB- 


and 


dSFF{<^)  I  _ a 

- 


-2u;5i  sin(u;A)  cos(u;A) 
— u;52sinu;A 


-u;52  sin(-;A) 
0 


-2.V(^) 


0  ^•sin(-.-A)  j 

sinlujA)  0  i 

(B-6) 


Therefore,  from  Eqs.  (17),  (B-2),  (B-4)  and  (B-6) 

^SffIu;)  I 

Sff(w)  «  Sff(w)  Ui»w,=o 


c>Sff(‘*'’)  I 

sO  +*^’2 - cTT -  lwi=wj=0 


=  4sin^(u;A) 


Si(u;)  0 
0  S2(UJ) 


-!-2.V(>--! 


+  jyiu;sin(u;A) 


-  u;2‘*'’sin(‘*'^) 


5t2 

1  —  cos(u;A) 

—  cos(-;A)  1 

0  45i(u;)  +  2-V(u;) 

45i(u;)  -i-  2.V(,*,')  852(.-')  cos(-,'A) 

85i(u;)  cos-;  A  452(u;)  +  2JV(u;) 

452(-;)  +  2-V(a;)  0 


(B-7) 
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Alternatively, 


45i(u;)  sin^(u;A)  +  2N{uj) 

—  4ci;5i(u;)  sin  2(u;A)  ^2 

—2N{(jj)  cos(a;A) 

+  uj  sin(a;A)(^i(4Si(u;)  +  2iV(u;)) 

-  02(452(0;)  +  2iV(u;))) 


—2N{uj)  cos(u;A) 

+  u;sin(u;A)(0i(45i(uj)  +  2N{uj)) 
—  02C452(o;)  +  2N{u/))) 

452(0;)  sin^(u;A)  +  2iV(o;) 

+  0io;452(u;)  sin  2(o;A) 


=  4 


5i(o;)[sin^(o;A)  —  o;sin2(o;A)  02]  o;sin(o;A)(0i5i(o;)  —  0252(o;)) 

o;sin(o;A)(0i5i(o;)  -  0252(o;))  52(uj)[sin^(u;A)  4- o;sin2(o;A)  vi] 

1  -jsin(o;A)(0i  —  1P2)  —  cos(o.’A) 

_  o; sin(o;A)(0i  —  02)  —  cos(o;A)  1 


+  2N{u;) 


(B-8) 


Notice  that  yi{t)  contains  only  S\{t)  and  noise  and  t/2(0  contains  only  S2{t)  and  noise,  so 
under  linearization  the  signals  are  separated. 

For  the  BB  configuration,  we  use  the  fact  that  Sgslo;)  =  Therefore, 

about  01  =  0,  t^2  =  0: 


c  /  _  r  1  o  /  M  ,  r  1  9Sff{^)  , 

SBfl(u;)  -  t4sin2u;(ri-r2)^"’"'^‘^^^^*=""=“'^'^‘^4sin2(o;A)  dr, 


2o;cos(o;A)^ 

4sin3(o;A)  l«'i=«'>=ol 


+  *^2  [7-7 


4sin^(o;A)  5t2 


5Sff('*')  I  ,  2o.’Cos(o?A) 

l«,,=v2=o  +  . ' .  3- — 7^5»ff(o;) 


4sin^(o;A) 


|vi=:V2=0j 


Sbb{^)  = 


1  2o;cos(o;A) 

+  sin»(a,A) 
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■  5i(u;) 

0 

UJ 

■  -25i(u;)cos(u;A)02 

0i5i(u;)  — 

0 

52(0;)  , 

sin(u;A) 

0iSi(a;)  -  02^2(0;) 

252(0;)  cos(u;A)  Vi 

+  2Nicj) 


\  cos(u/A) 

-  V2)  -  sm5(uS) 


+ 


sin^  (wA) 

J^(vi  -  ^2)  - 
2urcos(u;A) 


»iii(u/A)V'^l  -  'f'H  -  ,in2(u,A) 

r  Sliuj)  0 


I 

sin^(wA) 


sin(u;A) 
2N{ijj)2tjJ  cos(ajA) 


(-01  +  02) 


sin^(u;A) 


[—W\  +  ^2) 


0  52(u;)  J 

1  —  cos(u;A) 

—  cos(u;A)  1 

[  ~  52(ui){1  +  5CTW2} 


+  2JV(w) 


_  co«(u<A) 
sin^(wA) 


Therefore, 


Ssa(a;)  = 


Sl(‘>'Kl  -  ^'*1)  ss=3i(’(’i5>(“)  - 

L  ■52(i;)(l +;j^«'2) 


+ 


iV(u;) 


2sin^(a;A) 


(’^i  -  +  cos2(u;A)) 

—  cos(u;A) 


(^’1  -'^^2);ij^(l+cos2(^-A)) 
—  cos(u;A) 


1  +  i^(^2  -  <i’i: 


(B-IO) 


Here  also,  the  small  error  (0i  ss  02  ss  0)  guaxantees  separation  each  of  the  output  contains 
one  signal  only  (plus  noise). 
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Appendix  C 

From  [9]: 


/  sin^  xdx  —  5(x  —  sin  x  cos  x) 
f^dx  =  -cotx  =  -£21£ 

J  ain'^  X  unr 


(C-l) 

(C-2) 


Therefore, 


2.  .  .  1  /^(‘-o+M'/2)  ,  1  1 

/  sm  (u;A)du;  =  —  /  sm  xdx  =  — —  AW - sinA(2u;o  +  W) 

Juo-w/2  A  A(a/o-W'/2)  2A^  2 


Also, 

l‘wo+W/2  1 

Jwo-w/2  sin^  Au; 


1  sin  /\ 

+  ^5inA(2u,„-»')l  =  — [l-cos2a»A5;H^l  (C-3) 


1  1  _  1  .cosA(a>o  +  W/2)  _  cosA(u;o  -  W/2) 

aJm^-w/2)  sin^x  ^  A  sin  A(u;o  +  W/2)  sin  A(u;o  -  W/2) 


1  3inA(u;o-f -u>o-^)  _ W^ 

A  sin  A(uJo  +  y)  sin  A(u;o  -  y)  sin  A(u;o  +  y)  sin  A(w^'o  -  y ) 


=  2W 


sinWA  1 

WA  cos  AW  —  cos  2Au;o 


(C-4) 


Appendix  D 


In  a  general  backward  configuration,  y,(t)  =  z,(t)  -  hj{t)  *  yj{t)  (see  Fig.  B.l). 

The  impulse  response  of  the  filter,  h{t),  is  a  function  of  «m  unknown  parameter  (to  be 
controlled)  say  ^2-  Thus, 


yi{t)  =  zi{t)  -  f  h2{T)y2{t  ~  T)dT  -  Zi{t)  -  I  h{T,92)y2{t  -  T)dT  (D-1) 

•/— oo  y*- oo 

The  output  power  is  given  by  Pi  =  E{yl{t)}.  A  necessary  condition  for  minimization  of  the 
output  power  is  |^  =  0,  That  is; 

~  =  £^{2yi(0^(2i(f) /i(r,^2)y2(i  -  r)(iT)} 
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dh{r,e^) 

862 


Ry,n{T)dT 


{D-2) 


From  Eq.  (D-2)  we  see  that  «  0  is  a  sufficient,  but  not  a  necessary  condition  for 

=  0:  i.e..  decorrelation  guarantees  minimum  power,  but  not  the  other  way  around. 
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Figure  ?  different  structures  of  the  delay  control  separators  -  (a>  .i  **  basic  BB 
structure,  (b)  the  modified  BB  structure,  (c)  the  basic  FF  structure,  (d)  the  modified  FF 

structure. 
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Ayiy2(o<2)  =Z2 


Figure  3  Possible  implementation  of  the  adaptive  control  algorithm. 
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APPENDIX  F 

BROADBAND  INTERFERENCE  CANCELATION  USING 
A  BOOTSTRAPPED  APPROACH  ‘ 


by 


Yeheskel  Bar-Ness  and  Hagit  Messer 


ABSTRACT 


In  this  paper  we  present  a  novel  approach  for  rejecting  a  broadband  interference  from 
unknown  direction  when  received  by  an  array  of  two  sensors.  Two  configurations  of  such 
cin  approach  termed  “bootstrapped-based  algorithms'’  are  presented.  Both  configurations 
perform  perfect  interference  cancelation  when  the  input  signal-to-noise-ratio  (SNR)  is  large 
enough,  and  do  it  much  faster  than  the  common  LMS  interference  canceler.  However,  addi¬ 
tive  noise  causes  performance  degradation  to  both.  It  is  shown  that  no  general  claim  can  be 
made  about  the  superiority  of  one  of  the  configurations  with  respect  to  the  other.  The  out¬ 
put  signal-to  interference-plus-noise-ratio  (SINK)  depends  on  the  spatial  separation  between 
the  interference  and  the  desired  signal,  as  well  as  on  the  interference- to-noise  ratio  (SNR), 
in  a  different  manner  for  both  configurations.  The  paper  provides  guidelines  for  the  choice 
of  one  or  the  other  configuration  in  different  scenarios. 


^This  work  was  presented  at  ICASSP  ’93. 

This  work  was  partially  supported  by  grant  from  ROME  (AFSC,  Griffiss  Air  Force  Base,  NY)  under 
contract  F  30602-88- D-0025,  Task  C-2-2404. 
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L  INTRODUCTION  AND  BASIC  THEORY 

A  common  problem  in  many  fields  (e.g.,  communication,  radar,  sonar,  EM  etc.)  is  the 
need  to  cancel  a  spatial  interference  in  the  presence  of  a  desired  source.  The  conventionad 
approach  to  solve  this  problem  is  based  on  the  LMS  algorithm  [Ij.  For  narrowbeind  sign2Js, 
the  LMS  algorithm  is  used  to  adapt  complex  weights  so  as  to  minimize  mean  square  error 
between  the  array  output  and  a  reference  signal.  For  canceling  «in  interference  from  an 
unknown  direction  when  no  reference  is  available  a,  minimum  output  power  criterion  might 
be  used.  It  was  shown  by  Compton  [2]  that  this  criterion  leads  to  power  inversion.  That 
is,  if  the  input  signal  to  interference  ratio  (SIR)  is  p.  then  the  output  SIR  is  1/p.  Bar-Ness 
et.  al  developed  a  class  of  "bootstrapped  algorithms"  [3-5]  that  perform  perfect  interference 
cancellation  independent  of  the  input  SIR,  In  this  paper  we  use  the  boo*^ strapped  approach 
for  broadband  interference  cancellation,  where  the  complex  weights  of  the  netrrowband  case 
are  replaced  by  pure  delay  lines.  Unlike  the  narmwband  one,  in  this  case  the  open-loop 
system  is  a  non-linear  function  of  the  weights  (the  delays),  resulting  in  inherent  differences 
between  the  narrow  band  and  the  broadb2ind.  However,  following  the  Bar-Ness  approach 
we  developed  two  configurations  of  a  broadband  interference  canceler;  both  perform  perfect 
interference  cancellation  when  no  additive,  thermal  noise  is  present. 

The  two  bootstrapped  configurations  for  broadband  interference  cancellation  denoted  by: 
backward- backward  (BB)  and  forward- forward  (FF),  are  depicted  in  Fig.  1.  ci(t)  and  Z2{t) 
are  the  outputs  of  the  two  sensors  and  are  cissumed  to  be: 

zi(0  =  s{t  -  Ds)  +  i{t  -  D,)  +  ei{t) 

Z2{t)  =  s{t  +  Ds)  +  i{t  +  Di)  i- e2{t)  (1) 

where  s{t)  and  i{t)  are  the  desired  signal  and  the  interference  signal,  respectively,  radiated 
from  bearings  9,  and  ei{t)  and  e2(t)  are  the  additive  noise  processes  in  each  of  the  sensors 
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D,  =  ^sinds  and  Di  =  (2) 

where  d  is  the  separation  between  the  sensors  and  c  is  the  propagation  velocity.  We  assume 
that  the  signal  direction,  9,,  which  is  the  look  direction,  is  knotim,  while  the  interference 
direction,  di  is  unknown.  The  same  system  can  be  used  for  separation  of  two  sources  [6],  It 
can  be  shown  that  the  signal  denoted  by  y2{t)  in  Fig.  1  is  an  estimate  of  the  interference 
waveform.  In  our  special  case,  we  are  only  interested  in  the  estimating  the  desired  signal 
waveform.  This  is  given  by  the  output  yi(t).  We  assume  that  the  random  signals  s(t),  i(t), 
e\{t)  and  e2{t)  are  mutually  uncorrelated,  wide  sense  stationary  Gaussian  processes,  with 
power  density  spectrum  (PDS)  5(w),  and  E\{uj)  —  Eiiu)  =  N{uj),  respectively.  Based 
on  this  assumption,  the  PDS  matrix  of  the  signals  yi{t)  (the  output)  and  y^it)  in  the  BB 
configuration  of  Fig.  la  is  given  by: 

r  cf  ^  ■  T!  r,  ssinu/(0^-T)  sinw(g.-P.)  I 

+  / (w)(  -ri  )  ^(^Kinw{D3~r)  smw{Dt~T) 


siaw(Di-r)  siav(D,-IPi)  jr  sinw(0,-t?, )  \2 


siaw(Di-r)  sinw(D 


TTT)  sinu/(Z?,-r)  I 


N{uj)  1  -cosu;(Z?j-r) 

'^2sin^u;(D,  -  rj  -  cosw(£>,  -  r)  1 


^From  Eq.  (3),  the  output  PDS,  from  which  the  output  signal  to  interference  plus  noise 

ratio  (SINK)  can  be  calculated  for  any  r: 

siauilDi  —  t).,  /.\ 

5,,(u;)  =  S{u)  +  ^2sin2u;(D, -r) 

Similarly,  it  can  be  shown  that  the  power  density  spectrum  matrix  for  the  FF  configuration 

of  Fig.  l.b  is  given  by  : 


SFF(t*^)  =  4sin^u;(Da  —  t)Sbb{>^) 
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i,From  this  equation  we  see  that  the  power  spectrum  (amd  cross-spectrum  of  the  outputs)  of 
the  BB  and  FF  configurations  differ  only  by  4sin^u;(Z?j  —  r).  The  transfer  function  of  the 
BB  configuration  includes  a  pole  at  u;  =  0  and  therefore  cannot  process  baseband  signals, 
while  the  transfer  function  of  the  FF  configuration  is  a  zeros-only  one.  As  such,  the  FF 
configuration  can  handle  low-pass  signals  too,  and  is  adso  not  sensitive  to  situations  where 
Da  =  T.  Notice  that  the  BB  configuration  can  be  regarded  as  an  FF  one,  followed  by  a  2  x  2 
system  with  a  transfer  function  matrix  7n-..a-7n  rrl,  where  I  is  the  2-dimensional  identity 
matrix. 

Eq.  (3)  suggests  that  decorrelation  of  the  outputs  yi{t)  and  yjlO  is  a  reasonable  opti¬ 
mization  criterion  for  interference  cancelation.  If  no  noise  is  present  iN(u;)  =  0)  then  by 
imposing  decorrelation  of  yi{t)  and  y2{t),  i.e.,  by  controlling  r  so  that  the  off-diagonal  entries 
of  the  first  matrix  in  Eq.  (3)  are  zero,  a  perfect  interference  cancellation  is  performed.  Based 
on  this  idea,  the  control  algorithm  in  Fig.  1  is  chosen  to  be  decorrelation  of  its  two  outputs. 
That  is,  the  voltage  controlled  delay  line  wMch  implements  r  is  controlled  by  the  output  of 
an  integrator,  whose  input  is  the  correlation  of  yi{t)  and  y2{t).  Therefore,  the  steady-state 
value  of  r  is  that  for  which  the  off  diagonal  entries  of  Eq.  (3)  are  zero  for  all  uj.  In  the  next 
section,  we  present  a  comparative  study  of  the  two  canceler  structures. 

II.  THE  CONTROL  ALGORITHM 

The  algorithm  described  in  the  last  section  is  extremely  non-linear  in  r.  To  make  the 
theoretical  analysis  traceable,  we  assume  that  the  error,  o  =  D,  ~  t  is  small  and  we  take 
the  linearization  of  equations  (3)  and  (5)  to  be  about  0  =  0.  The  control  algorithm  in  the 
two  configurations  is  determined  by  the  cross  correlation  between  the  output  yi{t)  and  y2{t), 
which  is  the  inverse  Fourier  transform  of  their  cross-spectrum,  5i2(u;).  In  general,  it  can  be 
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described  by  the  differential  equation: 

~  =  kRuiO;  t)  =  kE{yi{t)y2{t)}  (6) 

where  k  is  a  constant  and  Ai2(a;r)  =  E{yi(t)y-iit  —  oi)]  is  the  cross-correlation  between  the 
outputs.  Under  small  errors  assumption,  this  cross  spectrum  is  given  by: 

(w)  «  <^sin(a;A)[4/(u;)  -h  2iV(u;)]  —  2N{u))  cos(u;A)  (7) 


where  A  =  Z),  —  Also 


Sj2  (^) 


-I-  <i>N{u) — r 


(8) 


4sin2(a;A)^"^’^“''  sin^(u;A) 

In  this  case,  the  non-linear  differential  equation  (6)  is  linear  in  r  and,  for  fc  =  1.  is  given  by: 

d<i>pf 


2jr- 


/oo 

u;sin(u)A)[4/(u;)  +  2N(u!)](iu; 

-oo 

-1-2  f  N{<jj)cos{uA)dw 

-/-OO 


2t 


d<t>BB 

~dr 


^u;sin(u;A)[4/(u;) -I- 2,^(0;)] 
4sin^(u;A) 


-I-  N{u) 


a;  cos' 


J-rxi  4sin^(u;A) 


sin^(u;A)  / 


(9) 


(10) 


For  the  special  case  where  the  spectrum  of  all  signals  is  flat,  that  is,  S{ui)  —  5.  I[uj)  —  I  and 
-V(u;)  =  N  in  the  band,  and  zero  elsewhere,  the  approximated  control  equations  become; 


ff  d4)fp 

2N  dt 


.  vv 

=  -<Pff{1+2pi)  ^  u;sin(u;A)(iu; 

-H  /  cos(ti;A)tL; 

Jwn - ar 


(11) 


27r  d<i>BB 

17  dt 


=  -  r: 

•'Wn— 

+  r*-’ _ 

Zwo-^  sin^(u;A) 


sin(u;A) 
cosfwA)  , 

diuj 


(2 


cos^(u;A) 

sin^(u;A) 


-h  2pi  -|-  l)du; 


(12) 
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where  ujq  =  27r/o  is  the  center  frequency  and  W  =  lirB  is  the  bandwidth  of  the  processing 
band.  In  Fig.  2  we  present  r  =  D,  -  as  a  function  of  time  as  derived  numerically  from  Eqs. 
(11)  and  (12).  In  both  cases  the  separation  between  the  sensors  is  d  =  30m.  £),  =  25nSec 
and  A  =  18n5ec.  In  Fig.  2a  pi  =  6QdB  (high  INR),  /o  =  3.005M H z  zmd  B  =  5.99M H z. 
In  Fig.  2b  pi  =  — 30dfi  (low  INR),  /o  =  12.75M Hz  and  B  =  2^.5M Hz.  In  both  cases, 
the  BB  configuration  (the  dashed  line)  converges  faster  than  the  FF  configuration  (the  solid 
line).  However,  due  to  the  presence  of  the  additive  noise,  the  algorithms  don't  converge  to 
the  true  delay  (Z?,  =  25nSec  in  our  example)  so  there  is  a  bias  in  the  estimate  of  the  un¬ 
known  delay  Di.  This  bias  is  larger  for  the  BB  configuration  in  both  cases  depicted  in  Fig.  2. 


III.  OUTPUT  SINK,  DISCUSSION  AND  CONCLUSIONS 

From  Eq.  (4)  we  see  that  indeed,  if  the  algorithm  converges  to  0  =  0.  the  interference  is 
completely  rejected.  For  any  other  r  ^  Di,  the  output  signal-to-interference-plus-noise-ratio 
(SINR),  for  the  case  of  flat-spectrum  signals,  is  given  by: 


=  2p.W 


1 


r«o  — -5-  l+2pi  sin^ 

2aiVw(i?,-T) 


du) 


(13) 


sin^u;(Z?,  —  r)du; 

SINR^^  =  Ps - ^  -  (14) 

W  +  pi  sin^  u/{Di  —  T)duj 

u/O**  "y 

where  p,  =  ^  is  the  input  signal-to-noise-ratio.  However,  under  a  small-errors  cissumption, 
this  output  SINR  become. 


5/iVRf  ®  w 


2p.W 

■I'j/o  — ^  2sin^(uiA) 


dui 


(15) 


5/iVZ2^^  s» /  *  (sin^(u;A)  —  (pa;sin(2u;A))diu;  (16) 

W  Vu/Q—  ^ 

^From  these  last  two  equations  we  see  that,  in  both  configurations,  the  output  SINR  is  not 
a  function  of  pj.  That  is,  if  r  is  closed  to  D,,  it  is  sufficient  to  guarantee  that  no  compo- 
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nent  of  the  interference  appears  in  the  output  y\{t).  Notice,  however,  that  the  interference 
rejection  causes  reduction  in  the  SNR.  That  is,  the  bias  in  the  estimate  of  Di  resulted  from 
the  presence  of  additive  noise  causes  only  degradation  in  output  SNR  (relative  to  the  input 
SNR  Pa)  while  leaving  the  output  SIR  (signad-to-interference-ratio)  infinite,  provided  that 
it  is  kept  small.  As  shown  in  the  numerical  exaunples,  although  both  configurations  of  the 
proposed  algorithms  guarantee  interference  rejections,  there  are  differences  in  their  perfor¬ 
mances:  rate  of  convergence,  bias,  region  of  operation  (bandwidth  etc.).  These  differences,  as 
well  as  quantative  comparison  of  the  proposed  approach  with  the  equivalent  LMS  canceler. 
are  now  under  ongoing  research. 
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Figure  2a  Delay  estimation  of  Dj  as  a  function  of  time.  For  FF  configmation  (solid  lines)  and 
for  BB  configuration  (dotted  lines),  £>,=4.33  lO"*  sec  (known)  £>^=2.5  lO"*  sec  (unknown). 
1=4  10-‘*  Watts/Hz,  N=4  Watts/Hz  B=5.99MHz  (/i=10KHz,  /2=6MHz)  resulted 
bias  for  FF=-5.57  sec  for  BB=-1.79  10"^^  sec. 
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xlO**  Time  history  behaviour  delay  estunanon  -  FF  &  BB 


Integradcm  time  points  xlO^ 


Figure  2b  Delay  estimation  of  A  as  a  function  of  time.  For  FF  configuration  (solid  lin  es) 
and  for  BB  configuration  (dotted  lines),  D,=4.33  10“*  sec  (known)  D.=2.5  10“*  sec  (un¬ 
known).  1=4  10-^*  Watts/Hz,  N=4  Watts/Hz  B=24.5MHz  (/i=500KHz.  /2=25MHz) 
resulted  bias  for  FF=-1.24  10“*  sec  for  BB=-3.53  10“*. 
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APPENDIX  G 


A  FORWARD/BACKWARD  BOOTSTRAPPED  STRUCTURE 
FOR  BLIND  SEPARATION  OF 
SIGNALS  IN  A  MULTI-CHANNEL 
DISPERSIVE  ENVIRONMENT  ‘ 

by 

Abdulkadir  Ding  and  Yeheskel  Bar-Ness 

Abstract 

This  paper  proposes  a  new  multidimensional  adaptive  algorithm  with  Forward/Backward 
bootstrapped  structure  for  dispersive  channel  environment.  It  is  an  alternative  multi-signal 
separator  where  the  loop-bandwidth  of  the  signal  separator  structure  and  steady  state  per¬ 
formance  are  crucial.  It  separates  superimposed  convolutive  multi  uncorrelated  signals.  The 
Bootstrapped  adaptive  algorithm  which  does  not  require  a  training  sequence  employs  the 
minimization  of  output  signal  correlations  as  optimization  criteria.  The  control  algorithm  is 
set  for  the  multidimensional  case.  The  learning  process  of  the  2  dimensional  signal  separator 
using  computer  simulation  is  investigated  and  compared  to  that  of  the  least  mean  square 
(LMS)  algorithm  for  different  cross  channel  eigenvalue  spreads. 


^This  work  was  presente  at  ICASSP  ’93. 

This  work  is  supported  by  grant  from  ROME  Air  Development  Center  (AFSC,  Griffiss  Air  Force  Base, 
NY  under  contract  F30602-88-D-0025,  Task  C-0-2456). 
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I.  INTRODUCTION 

Special  structure  multi-loop  separators  of  multi-chaniiel  superimposed  signals  sometimes 
termed  “bootstrapped  separators”  have  been  discussed  in  the  literature.  Applied  to  the  two 
signal  case  and  non-dispersive  channel,  three  structures  of  this  canceller  were  introduced 
[l].  These  were  referred  to  as  Forward/ Forward  (FF),  Backward/ Backward  (BB)  and  For¬ 
ward/Backward  (FB)  (or,  according  to  the  performance  criterion  used,  they  are  termed: 
correlator/correlator,  power/power,  and  power/correlator,  respectively).  One  or  the  other  of 
these  structures  proved  to  be  useful  in  practical  application  of  cross-polanzation  cancellation, 
e.g  satellite  communication  and  microwave  radio.  Applied  to  digital  communication  with 
high  M-ary  QAM  dually  polarized  signals,  it  was  recently  shown  [2]  that  the  bootstrapped 
separator  outperforms  other  signal  separators  including  the  LMS  (least  mean  square).  The 
average  symbol  error  probability  on  both  signals  was  shown  to  be  much  lower,  which  clearly 
indicates  that  the  bootstrapped  separators  result  in  deeper  cancellation  of  the  undesired 
signal  in  spite  of  the  fact  that  no  supervisory  signal  is  needed.  Furthermore,  due  to  the 
feedback  properties  of  the  bootstrapped  structure,  it  was  shown  [3]  that  the  learning  process 
is  shorter  than  that  of  the  LMS  cdgorithm,  particularly  at  low  signal-to-interference  ratios. 

Bandwidth-complexity  trade-offs  of  the  three  structure  are  discussed  in  [4].  It  was  found 
that,  particularly  when  it  is  applied  as  a  blind  separator  aX  very  high  RF  (radio  frequency) 
such  as  in  dually  polarized  satellite  or  microwave  terrestrial  communications  .  the  FB  struc¬ 
ture  has  the  best  system  bandwidth  complexity  trade-off  when  compared  to  the  other  two 
structures. 

Recently,  the  FF  and  BB  structures  of  bootstrapped  blind  signal  separators  have  been 
considered  as  signal  separators  in  a  dispersive  environment  [5,6].  But.  while  the  first  can 
tolerate  a  wide  system  bandwidth  it  requires  twice  as  many  channel  equalizers  as  the  FB 
structure.  On  the  other  hand,  the  BB  structure  can  use  simple  power  measuring  devices 
to  control  the  weight  and  requires  no  complex  channel  equalizer.  However,  it  is  very  much 


limited  in  handling  wide  bandwidth  signals. 

The  main  purpose  of  this  paper  is  to  present  stochastic  convergence  and  steady  state  per¬ 
formance  of  the  Forward/ Backward  structure  and  compare  it  to  that  of  the  LMS  algorithm. 

Without  loss  of  generality,  and  for  simplicity,  the  amalysis  is  done  with  a  two  input- 
output  separator.  After  introducing  the  structure  of  the  forward /backward  scheme  of  the 
bootstrapped  separator,  the  optimal  control  weights  will  be  presented  and  shown  to  lead  to 
a  total  separation  of  the  two  input  signals  in  the  noise-free  case.  Stochastic  approximations 
are  employed  to  show  convergence  in  the  mean  of  these  weights  to  their  predicted  optimal 
values.  The  performance  of  the  FB  bootstrapped  separator  for  a  dispersive  two  inputs-two- 
outputs  interference  channel  with  a  different  signal-to-interference  ratio  is  compared  to  that 
of  the  LMS  algorithm. 

IL  CHANNEL  MODEL  AND  PROBLEM  STATEMENT 

A  discrete  time  model  of  an  N-dimensional  dispersive  interference  channel  is  given  by 

x(n)  =  H(n)  *  I(n) -h  n(n)  (1) 

where  *  denotes  convolution  and  H  is  an  (NxN)  channel  matrix.  I  is  an  (Nxl)  information 
vector  assumed  to  be  independent  and  identically  distributed  sequence  and  n  is  an  (Nxl) 
white  Gaussian  noise  and  x  is  the  received  signal  vectors,  respectively. 

1  hi,v(n)  ' 

H  =  .  1  .  .  (2) 

_  h/vi(n)  •••  1 

The  channel  responses  are  assumed  to  be  slowly  time  varying  finite  impulse  response 
(FIR).  That  is,  the  channel  interference  filters  are  assumed  to  vary  slowly  with  respect  to 
the  signal  L(n)  rate  and  to  be  less  than  unity  in  magnitude.h,j(n)  i  ^  j  i,j  =  1.2...V 
are  transversal  filters.  /i°  ,  are  cross  channel  filter  tap  coefficients.  The  diagonal 

coefficients  hjj  i  =  l,2..iV  are  assumed  to  be  unity. 


Our  objective  is  to  find  a  multi  dimensional  bootstrapped  adaptive  algorithm  structure 
that  will  diagonalize  the  channel  matrix  H  without  using  a  training  sequence  and  compare 
its  convergence  with  that  of  an  LMS  algorithm  . 


III.  LMS  AND  BOOTSTRAPPED  ADAPTIVE  SIGNAL  SEPARATORS 
3.1  Multidimensional  LMS  Adaptive  Signal  Separator 

The  traditional  LMS  algorithm  which  minimizes  the  error  -.e^v}  ^.t  the  output 

of  the  separator  Fig.  can  be  used  as  a  multidimensional  signal  separator. 

The  error  at  each  output  is  given  by 


e,(n)  =  Xi(n)  +  5^w,j  - /,(n) 

j=i 

where 


(3) 


w.i  ♦  Xj(n)  =  ^  UJ,’"X;(n  -  m) 


(4) 


msO 


and  are  the  tap  weight  of  the  transversal  filter.  From  (3)  we  write 


dej 


dw^ 


^  =  2iJ,{e,(n)xj(n  -  m)}  m  =  0.  -  1) 


The  recursive  stochastic  weight  updating  algorithm  to  search  for  the  optimum  weights  is 
given  by, 


w.'jln  +  l)  =  w,'”(n)  - /ie,(n)X;(n  -  m),  =  1. 2...V 

e.{n)  =  y.(n)-t(n)  i  #  ;  (6) 

where  L(n)  is  the  reference  signal  vector,  obtained  by  the  help  of  the  training  sequence  or 
some  other  decision  feedback  means. 


^In  order  to  have  the  same  number  of  weight  as  in  the  bootstrap  structure  wu  were  taken  to  equal  unity 
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3.2  Multidimensional  Forward/Backward  Bootstrapped  Signal  Separator 

From  Fig.  2,  it  can  be  easily  shown  that  the  output  is  given  by; 

1-1 


y,(n)  =  z,{n)  -  w.^  *  Xfc(n) 


fcsi 


N 


-  ^tj*yAn) 

j=«+i 


(-) 


where  Wij*yj(n)  as  in  (4).  The  z-transform  of  the  tap  weight  vector  is  w,j(2)  =  ~ 

Denoting  each  tap  weight  vectors  as  the  entries  of  a  matrix,  we  define  two  (NxN)  weight 
matrices 


W 


tipper 


lower 

I 

— W/vi  -W,V2 
Using  (7)  together  with  (8)  and  (9),  we  can  write 


1  Wi2 
0  1 

0  0 
1 

-W21 


Win 

W2N 

1 


0 

1 


0 

0 


(9) 


W„ppe,  *y(n)  =  Wio,^„*x(n)  (10) 

Let  the  z-transform  of  the  signal  separator  output  vector  y(n)  be  given  by 

Y{z)  =  W„ppe,{z)-‘Wwr(.-)X(::)  (11) 

It  can  be  shown  that  in  aa  no  noise  condition,  the  suggested  bootstrapped  recursive  algo¬ 
rithm  will  result  in  a  matrix  N(z)  =  W“ppj^(r)W/ou,er(-)H(c)  whose  off-diagonal  entries  are 
zero. 


3.2.1  Optimal  Weights 

For  simplicity,  in  the  rest  of  the  analysis  we  show  the  optimal  weight  vectors  for  two 
dimensional  signal  separation  in  the  absence  of  noise.  The  optimum  weights  that  minimizes 
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the  output  correlations  are  obtciined  by  requiring 


Ry,y,{k)  =  E{yi{n  +  k)yj{n)}  =  0,;  i  #  j  tj  =  1,2..*V 


(12) 


For  Ii{n)  and  hin)  identically  distributed  zero  mean  independent  sequences  we  have 


El,{k)  =  cr^Sk,  i  =  1,2 


(13) 


Hence  by  using  (11)  we  get  for  the  cross-power  spectrum 

+  W,Az)[W2i{z)  -  -  ^V^2l(-'-‘)] 

-h  <tI[H,2{z)[1  -b  W,2iz)W2i{z)]  -  W,2{Z)][1  -  H,2iz-^W2i(=-A]  (U) 

There  are  two  optimum  adaptive  weight  vector  solutions  that  make  the  cross  power  spectrum 
in  ( 16)  to  be  zero.  They  are  respectively, 


W,pa(z)  = 


[WioMzhW2,pmiz)] 


r  Hnjz) 

A  ^  H2^{Z)H^2{Z) 

r  —Hujz) 

h~H2Az)Hn{z) 


H2i{z)] 


HuizV 


(15) 

(16) 


Using  the  desired  solution  (14),  the  outputs  of  the  two-dimensional  signal  separator  are  given 
by 

Y(z)  =  N(z)I(z)  (17) 


where 


N(z) 


1  0 
0  l-Hn{z)H2iiz) 


(18) 
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3.2.2  The  Search  for  the  Optimal  Weights 

The  control  aigorithm  simultaneously  minimizes  the  output  correlations  f(yi(n))yj{n  — 
m)  i,j  =  l..iV  z  ^  m  =  0,  —  1),  where  Mij  is  the  number  of  filter  taps  in  w,j.  The 

optimum  weights  can  be  found  by  successive  use  of  the  following  recursive  equations 

w[j(n  +  l)  =  w,'^(n)  - /i/(y,(n))yj(n  -  m) 

=  I..N  i  ^  m  =  0,  —  1  (19) 

where  /(y)  =  y^  is  an  odd  nonlinear  function  and  y.  is  the  stability  convergence  constant. 


rv.  SIMULATION 

The  inputs  /i(n)  i  =  l,2..iV  to  the  channel  are  taken  to  be  binary  ±  1  with  equal 
probability.  The  simulation  is  realized  for  a  two  dimensional  channel,  where  the  cross  channel 
filters  hi2(n)  and  h2i(n)  axe  chosen  to  be  3  taps  raised  cosine,  with  h{n)  =  i[l+cos(  ^(n— 2))] 
n=  1,2,3,  and  W=:2.9  [9].  To  the  outputs  of  the  channel,  a  Gaussian  white  noise  with  signal- 
to-noise  ratio  (SNR),  of  40  dB  is  added.  The  two  outputs  of  the  channel  are  used  in  one 
hand  tis  inputs  to  a  4-tap  LMS.  and  to  the  forward/backward  bootstrapped  adaptive  signal 
separators  in  the  other.  The  results  of  500  Monte  Carlo  runs  are  given  for  for  different  cross 
channel  coupling  ratios,  between  the  ith  and  jth  channel  inputs  defined  as 


SIR  = 


E{If{n)} 


where  k  is  varied  to  get  the  required  SIR.  We  took  signal  attenuations  h,,  =  1  and  interfer¬ 
ence  filter  coefficients  h,j  to  be  of  same  value.  By  setting  all  the  tap-weight  vectors  initially 
to  zero,  and  providing  a  constraint  1  -  //i2(-)//2i(-)  #  0  we  search  for  the  optimum  W^p^. 
The  learning  processes  of  LMS  algorithm  and  the  forward/ backward  bootstrapped  algorithm 
are  compared  for  different  cross  channel  coupling  levels. 

In  order  to  compare  the  two  algorithms  with  the  same  number  of  adaptive  filters,  the  weight 
vectors  Wn  =  W22  for  LMS  are  taken  to  be  unity,  that  is  w,,  =  [1.0..0]^. 
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V.  RESULTS 

In  this  section,  we  present  the  results  of  the  computer  simulations  for  different  SIR.  In 
Fig.  3  and  Fig.  4,  we  present  the  interference  of  the  power  residue.  The  learning  curves  with 
input  SIR  =  10.0,  7.6  and  5.6  dB  for  LMS  emd  F/B  bootstrap  respectively.  The  convergence 
constants,  fx  used  were  0.08  and  0.04  for  F/B  bootstrap  and  LMS,  respectively.  These  con- 
stajit  values  were  chosen  to  be  slightly  less  than  their  maximum  allowable  values.  In  Fig. 
5  we  compare  the  output  power  residues  of  the  LMS  to  those  of  the  bootstrap.  Note  that 
output  Vj  of  the  bootstrap  hais  high  residue  due  to  co  channel  distortion  as  is  reflected  in 
(17).  Channel  equalization  will  reduce  this  distortion  and  make  power  residue  comparable 
to  that  of  output  y\. 

VI.  CONCLUSION 

From  this  study,  we  conclude  that  forward/ back  ward  structure  of  the  bootstrapped  al¬ 
gorithm  might  be  proposed  as  a  multi-signal  separator.  However,  some,  but  not  all.  of  the 
outputs  of  the  separator  require  channel  equalizers.  For  total  signals  separation.  hi2(n) 
and  h2i(n)  are  FIR  filters,  ,  then  the  adaptive  filters,  W2i(n)  and  Wi2(n)  must  be  FIR  and 
HR  adaptive  filters,  respectively  (see  Fig  1).  For  the  system  to  be  stable  we  must  have 
1  —  ^  0-  That  is.  there  should  be  no  solution  on  the  unit  circle.  It  is  clear 

from  Fig.  5  that  the  Forward/Backward  separator  outperforms  the  LMS  separator  despite 
the  fact  that  the  reference  signal  was  not  used  in  the  former. 
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Figure  2  Forward/Backword  Bootstrapped  Canceller. 
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Figure  3  LMS,  two-dimensional  signal  separator. 
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RESIDUE  POWER,  dB 


Figure  4  Output  Yi  of  the  Forwaxd/Backward  2  dimensional  signal  separator. 
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residue  power,  dB 


Figure  5  LMS  and  F/B  separators  performance  comparison  SNR  =  40dB.  SIR=7.6  dB. 
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APPENDIX  H 


BLIND  DECISION  FEEDBACK  EQUALIZATION 
USING  THE  DECORRELATION  CRITERION  ‘ 

by 

Raafat  E.  Kamel  and  Yeheskel  Bar-Ness 

ABSTRACT 

A  new  blind  equalization  algorithm  is  presented  which  is  based  on  decorrelating  the  equal¬ 
izer's  output.  The  algorithm  is  used  with  a  decision  feedback  structure.  The  performance  of 
the  new  equalizer  on  nonrecursive  channels  is  illustrated.  The  resulting  equalizer  is  globally 
convergent. 


‘This  work  will  be  presented  at  Mini  Conference  Globecom  ’93  Nov.  1993. 

This  work  was  partially  supported  by  a  grant  from  Rome  Air  Force  Lab.  (AFSC),  Griffis  Air  Force  Base, 
N.Y.,  under  contract  F30602-88-D-0025,  Task  C-2-2404. 
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I.  INTRODUCTION 

Adaptive  equalization  has  been  used  to  mitigate  inter-symbol  interference  ( ISI)  in  high 
rate  data  communication  systems.  Conventionally,  the  process  is  initiated  by  sending  a 
training  sequence  which  helps  the  equalizer  adapt  to  the  unknown  channel  characteristics. 
At  the  end  of  the  training  period,  the  equalizer  operates  in  a  “decision  directed  mode.’’  That 
is,  the  detected  data  is  used  as  a  reference  in  the  adaptation. 

Blind  equalizers  are  those  which  do  not  require  a  training  sequence.  Such  equalizers 
axe  important  in  several  data  communication  scenarios,  such  as  multi-point  networks  [1]  or 
fading  channels  where  sending  a  training  sequence  is  inappropriate. 

It  is  important  to  emphasize  that  existing  blind  equalizers  are  the  finite  length  linear  FIR 
type,  whose  tap  gains  are  updated  by  minimizing  a  cost  function  that  merely  depends  on 
the  channel  response  and  the  statistical  properties  of  the  transmitted  sequence.  Therefore, 
the  quality  of  the  resulting  equalization  depends  directly  on  the  level  of  ISI  at  the  output  of 
the  channel. 

Most  of  the  previous  research  on  blind  equalization  was  devoted  to  designing  cost  func¬ 
tions  for  updating  the  equalizer’s  weights.  The  first  known  blind  equalization  algorithm  was 
introduced  by  Sato  [2].  The  cost  function  used  by  Sato  weis  gener«ilized  by  Godard  into 
a  class  of  algorithms  [1]  which  involved  higher-order  statistics  of  the  transmitted  sequence. 
Later  it  was  found  [3]  that  the  Sato  and  Godard  algorithms  suffer  from  ill-convergence.  They 
converge  to  local  minima  and,  hence,  are  incapable  of  reducing  ISI. 

Clearly  to  eliminate  ISI,  using  linear  equalizers,  one  must  achieve  the  channel  inverse. 
Such  an  equalizer  is  called  a  zero- forcing  {ZF)  equalizer  [4].  The  ZF  equalizer  is  known 
to  enhance  noise  at  frequencies  where  the  chemnel  spectrum  has  high  attenuation.  This  is 
undesirable  for  channels  that  are  subject  to  frequency  selective  fades,  e.g.,  radio  channels. 
On  the  other  hand  a  finite  length  linear  equalizer  can  only  approximate  the  inverse  channel 
response,  and  for  the  non-minimum  phase  system  the  inverse  filter  is  unstable. 
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The  above  factors  have  motivated  researchers  to  use  the  decision  feedback  equalizer 
{DFE),  depicted  in  Fig  1.,  which  can  compensate  for  amplitude  distortion  with  minimal 
noise  enhancement  [5j.  In  fact,  with  this  equalizer  structure,  the  forward  filter  C(z)  need 
not  approximate  the  inverse  of  the  channel  and.  thus,  it  avoids  noise  enhancement.  The 
feedback  filter  D{z)  is  used  to  remove  part  of  the  IS  I  caused  by  previously  detected  symbols. 
In  this  paper  we  restrict  ourselves  to  nonrecursive  channels  [moving- average  (MA)  models], 
since  we  axe  interested  in  frequency-selective  radio  channels,  i.e..  radio  links  with  multipath. 
Extension  to  a  more  general  channel  is  also  possible. 

Conventional  DFE  uses  a  preamble  during  a  training  period  and  switches  to  a  decision 
directed  mode  during  data  transmission.  Using  the  decision  directed  mode  in  blind  equal¬ 
ization  is  not  advisable  since,  if  the  initial  eye  is  closed  (z.e.,  the  initial  error  rate  is  high), 
the  equalizer  can  converge  to  equilibria  that  are  far  from  removing  ISI. 


Feedback 

Filter 

Figure  1  Decision  Feedback  Equalizer. 


This  paper  discusses  a  blind  equalization  algorithm  for  use  with  the  decision  feedback  equal¬ 
izer.  This  algorithm  is  based  on  decorrelating  the  sequence  at  the  input  of  the  sheer.  We 
show  that  this  algorithm  converges  to  the  correct  equilibrium  despite  error  propagation.  The 
paper  does  not  discuss  the  effect  of  noise  on  the  performance  of  the  equalizer.  In  section  2 
we  introduce  the  criterion  and  algorithm  used  for  the  blind  decision  feedback  equalizer.  In 
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section  3  we  discuss  the  dynamics  of  the  proposed  algorithm  and  show  the  effect  of  error 
propagation  on  the  performance  of  the  algorithm.  An  example  is  given  in  section  4  and 
conclusions  in  section  5. 

II.  THE  DECORRELATION  CRITERION  AxND  ALGORITHM 

The  channel  and  equadizer  model  under  consideration  is  shown  in  Fig.  2.  The  ceiscade  of 
the  transmit,  channel,  and  receive  filters  is  modelled  as  an  FIR  filter  with  impulse  response 

.V 

h{n)  =  1  +  ^  hi6{n  —  i) 

1=1 

where  8(-)  is  the  kronecker  delta.  In  the  above  equation  we  normalized  relative  to  the  first 
cursor  {ho).  A  more  general  model  would  merely  differ  by  a  gain.  We  also  assume  that  the 
input  Ik  is  a  binary  white  sequence  with  a  zero  mean.  The  channel’s  output  is  thus  given  by 


Xi  =  li,  +  '£hk/k-.. 

1=1 


Adaptive  Control 


Figure  2  Channel  and  DFE  model. 
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We  assume  the  chajinei  is  slowly  changing  with  time  and  the  receiver  hcis  perfect  cairrier 
and  timing  information.  Referring  to  Fig.  2,  the  input  to  the  slicer  of  the  decision  feedback 
equalizer,  .4*,  is  given  by 

Afc  =  .Yfe-A^W 

=  A  +  iUh-auw,  (1) 

where  Xk  is  the  output  of  a  moving  average  (MA)  type  channel  of  order  .V  +  1  and  is  given 
by 

«=i 

Afc-i  is  the  vector  of  the  past  N  decisions 

Afc_i  =  [Afc_i,  .4jk_2,  •  •  • ,  .4fc-,v]. 

The  prime  stands  for  transpose,  Ifc  i  is  the  vector  of  past  transmitted  information  bits 

Ifc-l  =  [h-iyh-2,  •  •  •  1  ffc-.v], 

where  Ik-,  takes  values  from  the  binary  alphabet  {  —  1, 1}  with  equal  probability.  W  and  H 
are  the  equalizer  and  channel  parameter  vectors  respectively; 

W'  =  [u;i,u72,---,u;,v] 

Multiply  eq.  (1)  by  Ak-i,  the  vector  of  past  sheer's  input,  where 

Afc_i  =  [i4fc_i,  Afc_2,  •  •  • ,  Ak-s] 

to  obtain 

AfcAfc_i  =  Ik-iAk-i  +  Afc_xIfc_2H  —  Afe_iA'^_jW.  (2) 
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When  taking  the  expectation  of  (2),  the  first  term  vanishes  since 

E{Ak-mIk-n}  =0  for  m  >  n, 

as  Ak  does  not  depend  on  the  future  data  inputs.  It  can  ^Jso  be  shown  that 

E{Ak.mAk-n}  =  0  for  m  >  n. 

Therefore, 


/  \ 

AkAk-2 


\  AkAk-N  J 


(  Ak-ilk-i  Ak-iIk-2 

0 


Ak~2h-2  •  •  *  Ak-2h-N 


Ak-ih-N  \  (  ^\  \ 

h2 


V  0 

•  •  •  Ak-sh-s 

) 

V  hs 

Ak-iAk-\ 

Ak-iAk-2 

•••  Ak^iAk  w  ^ 

f  Wi  ^ 

0 

Ak-2Ak-2 

•  •  •  Ak^2Ak-N 

W2 

V  0 

0 

•  •  •  Ak-NAk-N  / 

\  / 

(3) 


The  Icist  entry  of  (3)  can  be  written  as 


AkAk-s  =  Ak-wh-N^N  — 


From  ( 1 )  we  get 


r 


Therefore 


Ak-N  ^k—N  —  ^k—N  —  —  !• 


AkAk-N 


Wfi 


hN  —  |Afc_;v|u;/v 
ftjv  —  AkAk-N 

—  AkAk-Ni 


(4) 
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where  it  can  be  shown  that 


lAfc_n|  =  1  Vn. 

It  is  cleax  from  eqn.  (4)  that  ws  =  hs  iff  A^Ak-s  —  Ak  aJiff  Ak-N  decorrelated. 

Next,  consider  the  {N  —  l)th  entry 

AkAk-N+l  =  Ak-S-^l^k-N-\^N-l 

+  Afc_,V+l/fe-N^Af  “  Ak-N Ak-N 

A 

—Ak-N-klAk-N'^N- 

But  Ak-N-x-iAk-N+i  =  |Afc-,v+il  =  L  and  Ak-N-x-ih-N  =  aj  =  1.  Furthermore,  if  wn  =  /i.v 
then 

AkAk-N+l  =  ^N-i  -  WN-I  +  Ak-N+l  {h-N  -  Ak-N)hN 

=  A/V-1  —  tVN-l  •.  Ak-N+lSk-iV^N, 

where  ek  ^  Ik  ~  Afc*  Ws  can  also  show  that 

AfeAfc_iv+i  =  h,N-i  —  WN-i  +  2qk-NhN  (^i  +^^1)5 

(5) 

where  qk  =  P{ek  ^  0}.  For  the  mth  entry  we  have 

_  _  N  _ 

AkAk  — m  —  Afc  —mik—mhm  +  ^  fliAk  —mik—i 

i=m+l 

'  N  _ 

U7ni|A<;_m|  XViAk-mAk-i- 

i=m+l 

Following  the  above  argument  and  assuming  Wi  =  hi  for  i  =  m  +  1,  •  •  • ,  iV  then 
AkAk—m  ~  ~~  'b  hiAk—m  i^Ik-i  ~  Ak—i^ 

«=m+l 

—  hfm  ~~  "b  hiAk—m^k—i' 

i=TO+l 
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It  can  also  be  shown  that 


_  s 

AkAit-m  ~  {^i-m  "I"  ^i-m)  ■ 

i=m+l 

To  summarize,  we  combine  (4),  (5)  and  (6)  as 

AkAk-N  =  hs  —  WN 

A.kAk-iW+1  =  2qk-Nh{sf{hi  +  wi)  +  hs~i  —  ^N-i 
AkAk-s+2  =  2qk-,wfit^{h2  +  ujj)  + 

2qk-N+ihN-i{hi  +  wi)  +  hs~2  —  wjv-2 


(6) 


AkAk-i  —  2qk-,vhi\/{hs-i  +  + 

2qk-N-*-lhN-l{^N~2  +  WN-2) 

4 - +  2qk~2h2{h\  +  Wi)  +  hi  —  W\. 

(■) 


The  above  equation  is  based  on  the  assumption  that  the  previous  weights  converged  to 
the  correct  channel  parameters.  It  is  clear  from  (4)  that  wn  =  h^  ilf  AkAk-s  =  0-  Further 
if  is  zero,  i.e.,  Ak-s  was  correct,  then  u;/v_i  =  hs-i  iff  AkAk-iV-i-i  =  0.  Similarly  one 
can  proceed  and  reason  that  if  the  iV  —  m  previous  decisions 

(i4fc_,v+m,  m  =  1.  •  •  • .  iV  —  1)  were  correct  then  Wm  =  hm  for  m  =  I,  •••.  N  \S  AkAk~m  =  0. 
This  leads  to  W  =  H  together  with  Ak-m-,^  —  I-,-"  being  correct.  We  have  from  (1) 
that  Ak  is  the  correct  decision  and,  hence,  following  similar  reasoning  Ak.^.m  for  m  >  0  will 
be  correct.  This  means  that  if  we  reach  zero  probability  of  error,  the  algorithm  will  continue 
to  be  at  steady  state  of  no  ISI,  provided  that  Ak  is  decorrelated  with  the  previous  N  sheer 
inputs. 

If,  on  the  other  hand,  some  of  the  previous  decisions  were  erroneous,  then  the  algorithm 
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is  still  in  the  transient  state.  The  behavior  of  the  algorithm  in  the  transient  state  and  its 
convergence  to  a  zero  probability  of  error  will  be  discussed  in  the  next  section. 

To  control  the  weights  in  order  to  decorrelate  Ak's  we  use  the  steepest  descent  method. 
Any  stochastic  gradient  algorithm  can  be  expressed  as 

+  m/(-)  for  z  =  1,  •  •  • ,  iV,  (8) 

where  fx  is  the  constant  of  adaptation  and  /(•)  is  called  the  error  function  of  the  algorithm. 
The  roots  of  the  error  function  determine  the  steady  state  of  the  algorithm  values  to  which 
the  weights  will  converge. 

The  previous  discussion  suggests  using  AkAk-,  as  an  error  function  for  the  algorithm. 
An  appropriate  error  function  in  eqn.  (8)  would  be  f{AkAk-x)  such  that  /(O)  =  0  i.e.  f{x) 
should  have  a  root  at  zero.  Since  the  roots  of  the  error  function  represent  the  equilibrium 
points  for  the  algorithm,  some  of  which  might  not  be  the  optimum,  an  error  function  with 
a  distinct  root  at  zero  would  be  preferred.  Therefore,  a  possible  function  would  be 

fix)  =  X. 


As  a  result,  one  cam  write  eqn.  (8)  as 

=  Wi  +  fxAkAk-i  for  i  =  1,  •  •  • ,  iV. 

In  a  practical  implementation  one  would  estimate  the  expectation  by  its  current  realization, 
leading  to  the  stochastic  difference  equation, 

=  w-  +  nAkAk-i  for  z  =  1, •  •  • , N.  (9) 

It  is  clear  from  the  above  analysis  that  the  algorithm  in  eqn.  (9)  will  converge  in  the  mean. 
I.e.,  the  mean  value  of  Wi  will  converge  to  the  channel  parameter  A,. 
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III.  DYNAMIC  BEHAVIOR 

In  this  section  we  examine  the  dynamic  behavior  of  the  proposed  equalizer.  We  use  the 
probability  of  symbol  error,  qk,  at  instant  A:  as  a  performance  index.  A  difference  equation  for 
qk  is  developed,  which  can  be  solved  together  with  the  weight  update  equation  to  determine 
the  probability  of  decision  error  as  a  function  of  time  index  k.  The  derivation  given  in  this 
section  can  be  extended  to  a  general  order  N  moving  average  type  (MA)  channel.  However, 
for  the  sake  of  simplicity  we  consider  an  order  3  MA  channel.  (The  same  channel  will  be 
used  in  the  simulation  described  in  the  next  section.) 

The  channel  output  Xk  at  the  kth.  instant  is  given  by 

-Vfc  =  /fc  +  Ai/jfe-i  + (10) 

where  hi  and  Aj  are  the  channel  parameters.  From  (1)  the  sheer’s  input  is  given  by 

Ak  =  Xk-l  -  -  lU2*’Afc_2 

=  Ik-i  +  hiIk-2  +  ^2/fe-3  ~  —  ^2^^Ak-2i 

(11) 

where  we  have  used  the  superscript  k  in  the  weights  wi  and  W2  to  emphasize  their  dependence 
on  time,  since  we  are  studying  the  transient  response  of  the  algorithm.  Using  eqn.  (11)  we 
will  determine  the  probability  of  correct  decision  (qk)  as  a  function  of  the  index  k.  Using 
the  total  probability  theorem,  one  can  write 

qk  =  P{Ak  Ik-i} 

=  P{Ak  #  h-i  I  Ak-i  #  Ik-2,  Ak-2  #  Ik-3}qk-\qk-2 

+  P{Ak  #  h-l  I  Ak-l  #  Ik-2,  Ak-2  =  Ik-3}qk-lPk-2 

+  7^  Ik-I  1  Afc-I  =  Ik-2,  Ak-2  #  Ik-3}Pk-iqk-2 

+  P{Ak  ^  Ik-I  I  Ak-l  =  Ik-2,  Ak-2  =  Ik-3}Pk-lPk-'2, 

(12) 
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where  we  have 


P{Ak  #  Ik-l  I  ^fc-l  ^  Ik-2,  ^k-2  ^  Ik-z) 

=  fi{huh2,w[^\w[^^) 

P{Ak  #  Ik-l  \  ^k-l  ^  Ik-2,  ^k-2  =  /fe-3} 

=  f2{hx,h2,w[^\wi^^). 


P{Afc  ^  Ik-l  I  -^fe-x  =  h-2,  Ak-2  #  /fc-3} 


.  p  1/  ^  l  +  {h2  +  rV2  ) 

+  P  <  lk-2  >  —  ^fc)— 

=  f3{huh2,w[^\w^2^). 


P{Ak  ^  Ik-l  I  ^fc-l  =  Ik-2,  Ak-2  =  Ik-3} 

-  sH'->hs?) 

HSrl) 

=  f4{huh2,w[’‘\w[^^). 
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Substituting  the  above  in  equation  (12) 


qk  = 

qk~iqk-2fiihi,  /i2,  w['‘\ 

+ 

qk~iPk-2f2ihi,  *2,  u;^*^ 

+ 

Pk~iqk-2f3ihi,  h2,  u;l*\  u;J*’) 

+ 

Pk~\Pk-2h(hu  A2,  mi*’,  mi*’), 

(17) 

where  pk  is  the  probability  of  a  correct  decision.  Eqn.  (17)  is  a  second  order  difference 
equation,  which  depends  on  the  channel  parameters  hi  and  /12  «^d  on  the  current  equ<dizer's 
weights  and  For  the  more  general  order  iV,  channel  eqn.  (17)  will  take  the  general 
form 

qk  =  (18) 

The  instantaneous  probability  of  error  may  be  computed  recursively  using  eqn.  (18),  weights 
update  eqn.  (9),  and  the  appropriate  initial  conditions  for  the  probability  of  error.  Eqn.  ( 18 ) 
is  highly  nonlinear;  therefore,  only  low-order  channels  are  numerically  tractable  for  showing 
the  convergence  of  qk  to  zero. 

IV.  ILLUSTRATIVE  EXAMPLE 

In  studying  the  dynamic  behavior  of  the  blind  decision  feedback  equalizer  and  examining 
the  convergence  of  qk  in  eqn.  (17),  we  will  consider  two  approaches. 

In  the  first  we  will  use  the  mean  of  the  weights,  i.e.,  the  expected  values  of  and 
The  controlling  algorithm  will  be 

-I-  pAkAk-i  for  i  =  1,2,  (19) 

and  by  substituting  from  eqn.  (6)  we  get 

=  u;2**  +  p{h2  — 

^  =  u;|  ^  p{{hi  ~  ^)  -f-  2qk-2h2{hi  -H  uj|^^)). 
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Thus,  the  result  of  aumerical  analysis  will  show  the  behavior  of  the  algorithm  in  the  mean 
sense.  While  in  the  other  approach  we  use  the  stochastic  control  of  eqn.  (9)  directly. 

As  an  example,  consider  the  non-minimum  phase  response  of 

=  1  +  0.5z-‘  -  1.44r-^ 

and  depict  in  Fig.  3  and  Fig.  4  the  probability  of  error  as  a  function  of  k.  The  initial 
probability  of  error  used  was  q-2  =  9-i  =  5,  (90  =  4)-  Fig.  3  we  used  eqn.  (19)  for 

updating  the  weights,  while  in  Fig.  4  we  applied  the  stochastic  estimate  of  the  correlation 
as  in  eqn.  (9) 


0.6  I - 1 - r 


Figure  3  Probability  of  error  for  eqn.  (19) 


Figure  4  Probability  of  error  for  eqn.  (9) 
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With  both  approaches  we  notice  that  qk  converges  to  zero  «ifter  a  certain  number  of 
iterations.  Therefore,  all  the  q  terms  in  eqn.  (7)  vzuaish  and  the  weights  Wi  will  converge  to 
hi  iff  AkAk-i  for  i  =  1,2.  From  Figs.  3  and  4  one  would  note  that  the  probability  of  error 
qk  approaches,  zero  even  before  the  equalizer  convergence. 

The  chcuinel  above  was  used  in  a  computer  simulation.  The  weights  of  the  feedback 
filter  itfi  and  W2  axe  depicted  in  Fig.  (4),  the  adaptation  constant  used  was  /i  =  0.01.  In 
this  simulation  the  weights  were  initialized  to  zero.  Fig.  (4)  shows  that  the  equalizer's 
weights  converge  to  the  channel  parameters  (in  this  case  wi  s  0.5  <ind  W2  =  -1.44).  .Next, 
by  varying  the  initial  settings  of  the  equalizer  weights,  we  show  that  the  cilgorithm  always 
converges  to  the  right  point  (0.5,-1.44)  regtirdless  of  the  initial  condition.  Fig.  (5)  shows 
the  trajectories  for  the  different  initializations  tuid  shows  that  the  decorrelation  adgorithm  is 
globally  convergent  for  the  channel  under  consideration. 


Figure  5  Admissibility 
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V.  CONCLUSIONS 

In  this  paper  we  introduced  a  new  criterion  and  an  algorithm  for  blind  equalization.  The 
^dgorithm  was  used  in  conjunction  with  a  decision  feedback  equalizer.  It  decorrelates  the 
data  sequence  at  the  input  of  the  sheer.  It  was  shown  to  converge  to  the  optimum  irrespective 
of  the  initial  error  rate. 

Because  of  the  feedback  structure  the  equaUzer  does  not  suffer  from  noise  enhancement 
as  the  linear  equalizer  does.  A  simulation  example  of  a  dispersive  non-minimum  phase  chan¬ 
nel  was  given  to  illustrate  the  convergence  of  the  algorithm.  With  an  adaptation  constant 
/i  of  0.01  the  algorithm  converges  after  200  iterations.  The  simulation  also  shows  that  the 
algorithm  converges  to  the  optimum  point  regardless  of  the  initial  setting. 

VI.  APPENDIX 

Claim  1  The  probability  density  function  )  of  the  random  variable  Ak  defined 
in  eq.  (1)  is  an  even  function. 

Proof 

The  input  to  the  sheer  in  eq.  (1)  Ak  is  given  by 

.V 

Ak  =  Xk-Yi  Afe_, 

i=sl 

iV 

—  f fe  "b  (^hilk—i  WiAk~^  • 

t=i 

If  we  denote  the  set  of  all  correct  decisions  by  A'  and  the  set  of  ail  incorrect  decisions  by  A". 
j.e., 

A'  =  {A,  :  A,  =  li} 

A"  =  {A,  :  A,  =  -/J, 
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then  the  input  of  the  sheer  in  (A.l)  can  be  written  as 

Ak  =  lk+  Y.  {hi  -  ^i)  Ik-. Y  {hi  +  Wi)  Ik-..  (A.2) 

From  the  above  equation  one  can  see  that  Ak  can  be  expressed  as  a  sum  of  independent 
random  variables.  Therefore,  the  probability  density  function  (pdf)  of  Ak  is  the  convolution 
of  the  individual  pdfs,  thus, 

/a,  =  //*  *  Conv  ^^_^^^, *  Conv  ^^__^^„ ,  ( A.3) 

where  Conv  .  and  Conv  .  „  are  the  convolution  of  the  probability  density  functions 

of  the  corresponding  random  variables  in  the  summations  of  eq.  (A.3).  Since  Ik  s  are  random 
variables  taking  values  of  —1  and  1  with  equal  probabilities  we  have 

/,.(l)  =  i(«(x  +  l)  +  «(l-l)) 
f(h.-u,i)iH-.{^)  =  ^{S{x  +  hi-Wi)  +  6(x-hi  +  Wi)) 

/(h.+w,)A..(a:)  =  i(^(a;  +  /ii  +  u;.)  +  ^(x-/ii-u>i)). 

The  convolution  equation  in  (.A.3)  can  be  transformed  into  a  product  form  by  using  the 
Fourier  Transform 

^Ak-^ik'  n  -«'.)/*-.  •  n  (a.4) 

i-.Ak-,f-A" 

where  !Fx  is  the  Fourier  Transform  of  the  pdf  of  the  random  variable  X.  Therefore,  we  have 

-  cos(u;) 

^(h,~.u,)iu-.{^)  =  cos((Ai  -  u;,)u;) 

)/»_.(«)  =  cos{{hi  +  Wi)u). 

Now  we  consider  the  product  terms  in  eq.  (A.4).  The  first  term, 

n  L  cos(a,u;), 

i:Ak-.cA'  “• 
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where  |/1'|  is  the  cardinality  of  the  set  A'  and  a^s  represent  all  the  possible  sums  and  differ¬ 
ences  aunong  all  {hi  —  Wi)  such  that  Ak-,tA*. 

Similarly,  for  the  other  product  term  in  eq.  (A.3)  one  can  write, 

n  ^  cos(6iu;), 

where  |i4"|  is  the  cardinality  of  the  set  A"  and  6,s  represent  all  the  possible  sums  «md 
differences  among  all  (h,  +  lUi)  such  that  Afc_,cA". 

As  a  result  eq.  (A. 4)  can  be  written  as 

=  cos(u;)  •  Y.  cosfUiu;)  •  Y  cos(b,u;) 

-a,  “  b, 

=  COs(uj}  ■ 

“  a.  6, 

=  cos(u;)  •  Y  ]L  +  bi)u;)  +  cos((a,  -  b,U} 

“  a,  4, 

♦ 

=  cos(u;)  •  Y  cos(c.w), 

“  Ci 

where  Ci  represents  all  the  possible  pairwise  sums  and  differences  of  a,s  and  b,s.  Further,  one 
can  write 

cos((ci  -H  l)u;)  +  cos((c,  -  1 (A. 5) 

“  Ci 

Taking  the  inverse  transform  of  eq.  (A. 5),  we  czm  write  the  pdf  of  Ak  as 

IaM  =  ~  +  c«  +  1)  +  -  c,  +  1)  6(x  ^  c.  -  1)) .  (A.6) 

Therefore,  the  pdf  of  Ak  is  an  even  function,  and  it  also  exhibits  half  symmetry  about  ±i. 


Claim  2 


Proof: 


E{Ak-mAk-a}  =0  for  m  >  n 
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Consider  the  joint  cumulative  distribution  function  (CDF)  of  Ak-mAk-n  vis 

=  P{^k-m  <  X,ifc-n  <  y} 

~  P {^k—m  —  X,  Ajt_Tx  ^  y  I  /ifc— n  —  ^k—n}P 

+  P{Ak-m  <  X,/ifc_n  <  y  I  Ak-n  =  -4-n}<? 

=  P{Ak-m  <  Xjk-n  <  y  I  Ak~n  =  Ik~n}P 

+  P{Ak-m  <  X,-/fc-n  <  y  1  Ak-n  =  -Ik-n}q, 


where  p  is  the  probability  of  correct  decision  and  q  is  the  probability  of  incorrect  decision. 

=  P{Ak-m  <  X  \  Ak~n  =  Ik-n}P{Ik-n  <  y  \  Ak-n  =  U-n]P 

-i-P{Ak-m  <  X  I  Ak-n  =  —h-n}P{-Ik-n  <  i/  |  Ak-n  =  -h~n}q 
=  P{Ak.m  <  X,Ak-n  =  Ik-n}P{Ik-n  <  J/  |  Ak~n  =  h-n} 

+  P{Ak~m  <  X,  Afc_n  =  -Ik-n}P{-h-n  <  y  1  Ak-n  =  -  h-n} 

(A.7) 


since  Ak-m  is  independent  of  Ik-n  for  m>  n.  By  definition 

P{Ik-n  <  y  I  Ak-n  =  Ik-n)  =  T  S{p  -  \)P{Ik-n  =  1  I  =  h-n] 

oo 

+5(/i  +  l)P{/fc_n  =  -1  !  Ak-n.  =  Ik-n}<lp- 

(A.8) 


Now.  from  eq.  (1)  we  write 


Ak—n  —  Ik—n  "b  ^k—ni 


where 


^k-n  =  [hilk-n-t  -  WiAk-n-i)  ■ 

1=1 


From  the  definition  of  Ak, 


P{Ak-n  =  Ik-n  \  Ik-n  =  i)  =  ^{sgn(  Afc_„ )  =  /fc_„  |  =  1 } 
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Similarly, 


=  P{sgn(l  +  Ffe-n)  =  1) 

=  P{n-n>-l). 


P{Ak.n  =  Ik-n  1  Ik-n  =  ~l}  =  P{Yk-n  <  l}- 


However  from  Claim  1  of  this  appendix  the  pdf  of  Ak  and,  hence,  of  Ak-n  and  Yk-n  is  even. 
This  leads  to 


P{Ak~n  =  Ik-n  1  h-n  =  1}  =  P{Ak-n  =  h-n  |  h-n  =  -!}• 


(A.9) 


Now,  using  Bayes  law, 

p(  T  _1|,4  _r  1_  ^{Afe-n  =  Ik-n  |  Ik-n  —  ^}P{Ik-n  =  1} 

F{Ik-n  -  I  \  Ak-n  =  Ik-n\  =  - — “j - - - 

*  \^k—n  ik—n 

/>{/,.„  = -11  A,-,  =  4-4  =  =  =1), 

{-*1^:— n  ”  Ik—n 

Therefore,  by  using  eq.  (A.9)  we  get 

P{Ik-n  —  1  1  Ak-n  =  Ik-n}  =  P{Ik-n  —  —1  |  Ak-n  —  h-n}  = 

Hence,  we  can  write 

P  {h-n  <  y  \  Ak-n  =  h-n}  =  «/  1)  +  +  U) 

^  J^oo 


Similarly,  it  can  be  shown  that 


P  {- h-n  <  y  \  Ak-n  =  — h-n}  =  x/  “  1 )  +  ^(  M  +  1 ))  d/X 

Z  */— 00 


=  f'u-niy)- 

Substituting  eqs.  (A. 10)  and  (A. 11)  in  (A.7),  we  get 

y)  ~  P{Ak-m  ^  X,Ak-n  =  h-n}Pli,^„{y) 

+  P{Ak-m  <  xAk-n  =  -h-n}Fl,,.„{y) 


(A.IO) 


(A.il) 
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Therefore,  the  joint  pdf  of  Ak-m^k~n  is  given  by 

Hence, 

E{Ak-mAk~n}  ~  E{Ak-m}E{Ik-n} 

=  0. 

Claim  3 

Ik-mAk-n  =  0  n  m 

Proof: 

We  have 

~  -  y} 

—  P{Ik-m Ui  Ak^n  ^  X  I  Ak-n  —  Ik~ri} P{‘'^k—n  —  ^k-n} 

-^P{Ik—m  ^  y^Ak—n  ^  ^  1  Ak—n  ~  Ik—n}P{Ak—n  —  ■ffc— n} 

=  P{Ik-m  ^  Vi^k-n  ^  ^  I  Ak-n  —  ^k~n}Pk-n 

-\-P{Ik-m  ^  Vilk-n  ^  ^  I  ^fc-n  =  ~Ik-n}<ik-n- 
Ik-m  independent  of  Ik-n  for  m  ^  n 

=  P {Ik-m  <  y  \  Ak-n  =  Ik-n]P{h-n  <  I  \  Ak-n  =  Ik-n}Pk-n 

•\-P{Ik-m  ^  y  1  Ak-n  —  ~Ik-n}  P{~Ik-n  ^  ^  I  ■^fc-n  =  ~  Ik-n}Qk-n- 

Using  eqs.  (A.9)  and  (A. 10),  we  get 

^A„-„I„-„i^'y)  =  P{h-m  <  y,Ak-n  =  Ik-n-l}Fu.n.d^) 

+  P{Ik-m  <  y,Ak-n  =  -/fc-n-l}F;»_„_,(x) 

=  Pi,-Jy)Fi.-n{^l  {A.12) 
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Therefore,  from  eq.  (A. 12),  we  can  conclude  that 


Afc-n-ffc-m  —  Ik-m^k-n- 


=  0 


(A.13) 


Claim  4 


Proof: 


E{|Akl}  =  1  for  every  n 


The  pdf  /|^*|  of  the  random  variable  |Ait|  can  be  expressed  as 

f\Ak[K^)  "  I  0  X  <  0 

_  f  2/aJx)  X  >  0 

•”  \  0  x<0 


since  is  an  even  function. 

Substituting  from  eq.  (A. 6) 


_  /  T^TT 

^‘1  -  \  0 


i:c,(<J(x-|l  +  c.|)  +  .5(x-il-c.|))  x>0 

X  <  0. 


The  above  equation  is  symmetric  about  x  =  1,  therefore  the  mean 


E{\A,\}  =  1. 


Claim  5 


(A.14) 


For  m  #  n  Ak_niAic_n  =  0 
m  =  n  A?  „  =  1 


Proof: 
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Assume  m  <  n,  then 


A  *  ^  - 

=  P{Afe— n  ^  X,  i4fc— rn  ^  y  I  *  ifc-m/Pfc-m 

+-P{.i4fc_fi  ^  X,  Afc_rn  ^  y  1  Afc-m  —  ~ Ik-m}^k~m 

A  A 

—  P{Ak—n  ^  ^  1/  1  Afc_m  —  ^fc-m/Pfc— m 

+  -P{Afc_fi  ^  X,  ~Ik—m  ^  y  I  Aji;_ni  =  ~Ik—m}^k—m- 

Ak-n  depends  only  on  Ik-m  for  rn  >  n,  hence,  it  is  independent  of  all  Ik-m  with  m  <  n. 
Therefore, 

^  Ak  m-dfc  n  ~  P{Ak—n  ^  ^  1  Ak—m  ~  /fc— m }  •^{  ffc-m- 1  ^  y  1  Afc-rn  =  fk— m}pfc-m 

■^■P{Afc_n  ^  I  Afc— m  —  ~  Jk—m}  P  {~  ^k—m  ^  y^  |  Afc_ni  —  ^k—m^Qk—m 

—  P{Afc-.n  ^  X,i4k-in  “  Jk-m) P{ik~m  ^  If  I  Afc-m  ~  ■ffc-m} 

"^P  { Afc_n  ^  X,  Ak—m  ”  ~ik—m  }  P  {~^k-m  ^  y»  I  Ak—m  ~  ~Ik-m  }  • 

By  using  eqs.  (A. 9)  and  (A. 10),  we  get 

^A„.„Ak-n  ~  P{Ak-n  ^  ^^Ak-m  =  U-m}Pl,,^„{y) 

+  P{Afc_„  <  X.Ak-m  =  -h-m}Fl„.„{y) 

=  ^A,,„i^)^u-Jy)-  (A. 15) 

Therefore, 

Ak_niAfc_„  —  Ak—n^k—m  —  l 

=  0.  (A.16) 

For  m  >  n,  a  similar  proof  can  be  shown  by  conditioning  on  Ak-n  instead. 

For  m  —  n.  since  the  pdf  of  Ak-n  is  even,  it  follows  that 

P{Afc_„  =  l}  =  P{Afc_„  =  -l}  =  ^. 
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From  the  above,  it  is  straightforward  to  show  that,  for  m  =  n, 


AU  =  .1 


Claim  6 


For  m  +  1  <  i  <  JV 


A.k-m®k-i  —  Ak-m  (ik-i  ~  Ak-i) 
=  2c]k— i  (hi-na  + 


where  qk-i  is  the  probability  that  Ak~i  ^  h-t- 


Proof: 


Note  that 


Ak-m^k-i  —  Ak^m ^k~i  ”  Ak-mAk-i- 


From  eq.  (1), 

N  N 

Ak~m  —  tk-m  +  ^  hjlk-m-i  ~  ^  ^jAk-m-j’ 
j=i  ;=i 

We  consider  each  term  separately: 

_  N  _  .V  _ _ 

Ak-mh-i  =  Ik-mik-i  +  ^  hjik-m-jik-i  ~  ^  WjAk-m-jh-i- 

j=i  ;=i 

The  first  term  in  the  RHS  is  zero,  since  i  >  m.  Similarly,  the  summation  in  the  second  term 
is  j  =  i  —  m.  Using  the  result  in  Claim  3  the  terms  in  the  second  summation  are  all  zero 
except  for  j  =  i  —  m.  Therefore, 


Ak—m^k—i  —  ^i~mAk-^iJk—i' 


(A.17) 


Now,  consider 


_  _  iV  _  N  _ 

Ak—mAk—i  —  ik—mAk—i  +  ^  !  hjlk—m—jAk—i  “  ^  Afc— m— j  Afc-|. 

j=l  i=l 


209 


Using  Claim  3,  the  first  term  is  zero.  Furthermore,  using  the  same  claim,  the  only  non-zero 
term  in  the  first  summation  is  j  =i  —  m.  On  the  other  hand,  using  Claim  5  the  only  non-zero 
term  in  the  second  sum  is  j  =  i  —  m. 


If,  on  the  other  hand,  {hi  +  <  0,  then 


V  =  -\P{Ik-x< 


1  -  (^2  + 


(k) 


hi  +  Wi 


(k) 


■}  +  {p{Ik.l  < 


1  ~  (^2  +  U>2*\ 
hi  + 

1  —  (^2  +  U^2  ^ 


} 


hi+w[‘‘'  '  '  /n  +  u;W 

The  last  step  follows  since  the  pdf  of  Ik-i  is  an  even  function.  Therefore,  combining  the 
above 


1  +  (hi  +  u;i*^)/fc_i  +  (^2  +  >  0} 

1  /prr  .  l-(A2+tnJ*h  .  l  +  ih2  +  w[‘‘^) 

-  I  PUk-i  >  .(*),  }  +  >  -77— jiM 


ihi+t^n 


Ihi  +  lui 
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APPENDIX  I 

ADAPTIVE  TWO-STAGE  DETECTION  SCHEME 
IN  SYNCHRONOUS  TWO-USER 
CDMA  SYSTEMS^ 

by 

Zoran  Siveski  and  Yeheskel  Bar-Ness 

ABSTRACT 

An  adaptive  two-stage  scheme  for  a  synchronous,  two-user  CDMA  environment  with 
unknown  received  signal  energies  is  presented.  It  consists  of  a  tandem  of  the  matched  filter 
front-end  followed  by  the  interference  canceler  whose  weights  are  adjusted  by  an  adaptive 
algorithm.  The  error  probability  was  evaluated  analytically,  and  it  was  shown  that  the 
receiver  provides  satisfactory  performance  in  the  near-far  scenarios. 


^This  work  will  be  presented  at  Milcom  ’93. 

This  work  was  partially  supported  by  a  grant  from  Rome  Air  Force  Lab.  (AFSC,  Griffiss  Air  Force 
Base.  NY  under  contract  F30602-88-D-0025,  Task  C-2-2404. 
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I.  INTRODUCTION 

A  conventional  single-user  detector  implemented  in  the  Code  Division  Multiple  Access 
(CDMA)  system  consists  of  a  bank  of  filters,  eaich  one  matched  to  the  signature  sequence 
of  the  particular  user.  The  sampled  output  of  each  matched  filter,  besides  the  desired 
signal,  contains  the  residual  interference  from  all  other  users.  Careful  choice  of  the  signature 
sequences  can  reduce  the  timount  of  interference  if  the  received  signal  energies  are  similar. 
However,  the  presence  of  a  strong  interference  often  makes  it  impossible  to  detect  the  weak 
user,  a  condition  referred  to  as  a  near-far  problem.  In  [1]  a  receiver  that  is  optimum  in 
the  multiuser  interference  environment  was  proposed  and  shown  to  provide  much  improved 
performance.  The  improvement  comes  at  the  expense  of  high  computational  complexity.  .A 
class  of  suboptimum  receivers  that  uses  decorrelating  detectors  ajid  which  is  based  on  the 
linear  transformation  of  the  sampled  matched  filters’  outputs  was  considered  in  [2]  and  [3]. 
Another  approach  for  suboptimum  multi-user  detectors  with  low  complexity  was  proposed 
in  [4]  and  [5],  where,  in  order  to  perform  detection  of  the  desired  user,  tentative  decisions  op 
information  bits  of  ail  other  users  are  made.  The  estimate  of  the  multiple  access  interference 
is  then  obtained  and  is  subtracted  from  the  desired  signal.  The  performance  of  some  of 
these  is  close  to  the  performance  of  the  optimum  detector,  particularly  when  the  power  of 
the  interferers  increases,  they  become  indistiguishable.  These  schemes,  however,  have  to 
perform  an  estimation  of  the  received  signal  energies,  knowledge  of  which  is  required  for  the 
detectors’  proper  operation. 

In  this  paper  a  two-stage  detector  similar  to  one  proposed  in  [5]  is  considered,  except 
that  the  received  signal  energies  are  not  assumed  to  be  known,  and  therefore  the  canceler's 
weights  are  adjusted  adaptively.  A  simple  iterative  algorithm  is  proposed  in  order  to  control 
the  weights  in  the  second  stage  of  the  receiver.  The  output  error  probability  is  computed 
and  compared  to  the  one  of  the  conventional  receiver,  the  decorrelating  detector,  and  the 
detector  in  [.5]. 
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II.  TWO-STAGE  ADAPTIVE  DETECTOR 


In  this  paper  we  restrict  ourselves  to  a  two-user  synchronous  CDMA  receiver  shown  in 
Fig.  1.  It  consists  of  two  stages:  a  matched  filter  front-end  followed  by  a  dual  interference 
czmceler  with  the  forward- forward  structure.  The  received  signal  x{t)  can  be  written  as: 


x{t)  =  -  iT)  +  n(t)  ( 1) 

t 

where  61,62  €  {  — l.-bl}  are  users’  data  bits,  and  Ai  and  A2  their  respective  energies,  un¬ 
known  to  the  receiver.  The  signature  sequences  Si(t)  amd  S2{t)  are  known  to  the  receiver,  each 
having  same  duration  T  as  a  data  bit.  Denoting  the  normalized  crosscorrelation  parameter 
of  the  sequences  as  p  we  have: 


fT 

/  s^:{t)dt  =  1,  j  =  1,2  and 
Jo  •' 

/  siit)s2{t)dt  =  p  <  I  (2) 

Jo 

The  additive  noise  n(f)  is  Gaussian,  with  a  zero  mean  and  a  power  spectrad  density  of  .Vo/2. 
In  the  ith  bit  interval  the  sampled  outputs  of  the  first  stage  are: 


Ji(i)  =  \/^6i(z)  -t-  p\fA2b2{i)  +  n\(i) 

•2^2(0  =  + /i?y^6i(i) -f- ri2(i)  (3) 

where  ni(i)  and  n2(i)  are  zero  mean  Gaussian  random  variables  which  can  eaisily  be  shown 
to  have  variances  of  No/2,  and  the  crosscorrelation  pNo/2.  (For  the  sake  of  brevity,  time 
index  i  is  omitted  from  most  of  the  expressions  in  the  text.) 

The  first  stage  bit  estimates  are  defined  as: 


61  =  sgn[xi]  and  b2  =  sgn[x2] 


(4) 


yielding  the  two  outputs  of  the  second  stage: 


yi 


\J~A\b\  -J-  p\J A262  —  u;i62  -b 


ni 
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(5) 


=  +  P\fAxb\  —  1^261  +  n2 


The  control  algorithm  simultaneously  minimizes  the  output  powers  and  E{y\]. 

The  optimum  weights  iure  obtaiined  by  using  an  iterative  search: 


Wj  *—  Wj  —  fX 


dE{y]} 


;  =  L2 


where  p  represents  the  convergence  and  stability  rate  constant.  The  optimum  weights  that 
minimize  the  output  powers  are  the  steady  state  values  obtained  from: 

dE{yl}  d  j-  2. 

dwi  dwi 

=  E{{Xx  -  =0 


and 


dEjyl) 

dW2 


E{iX2-W2ll}i-ll)}  =0 


(-) 


and  are  expressed  as: 

li'io  =  \/^E{bxb2}  +  P\f^E  {b2b2}  +  E{nib2} 

W20  =  \f^2E{b^\)  +  p\J~A\E{b\b\}  +  E{n2bi}  (8) 

The  joint  statistics  appesuing  in  the  above  expressions  are  evaluated  in  terms  of  the  system’s 
parameters  and  are  presented  in  the  Appendix.  After  substituting  the  optimum  weights  the 
canceler  outputs  become: 


y\o  — 

■I"  PyJ A2  [f>2  “  +  E{Tlib2}  +  Til 

1/20  =  [f>2  ~  E {b2bi}bi  (9) 

+  P\fM  [^1  “  +  E{n2bi}  +  n2 
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^From  the  above  expressions  one  can  conclude  that  if  the  bit  estimates  of  the  sampled 
correlators’  outputs  were  cilmost  perfect  (i.e.,  b\  25  6^  and  ^  6^),  the  decision  variables  at 

the  canceier  output  become  interference  free  (i.e..  yio  ^  ^nd  1/20  ~  +  ^2)- 

The  error  performance  of  each  user  will  be  determined  by  their  respective  input  signal-to- 
noise  ratios,  SNRi  =  Ai/Nq  and  SNR2  =  A2/N0  only.  This  scenario  requires  a  system  with 
a  rather  low  spectral  efficiency  (small  p),  and  occurs  whenever  both  SN Rs  are  large  enough 
and  are  approximately  equal. 

If  the  power  of  one  of  the  signals  is  large  enough  in  comparison  to  the  other  such  that, 
say  p^SNR2  >  SNRi,  Qi  will  continue  to  be  an  almost  perfect  estimate  of  62-  Referring  to 
(8),  luio  P\/A2,  and  the  output  1  will  again  be  interference  free.  However,  the  signal  Xi 
will  now  be  dominated  by  the  interference  from  user  2.  and  b\  will  mostly  be  estimated  as 
62.  By  observing  (8)  again,  one  can  see  that  it  will  cause  W20  ss  \/A2,  which  is  obviously 
larger  than  wiq.  This  results  in  the  total  cancelation  of  the  desired  signal  2  in  the  second 
output,  which  is  expected  because  of  the  power  inversion  effect  of  the  canceier.  The  decision 
variable  of  user  2  becomes  y2  ^  p\/Aib\  +n2,  yielding  to  the  disastrous  output  performance. 

.An  easy  and  logical  remedy  to  such  a  problem  may  be  obtained  by  adding  a  constraint 
to  the  iterative  algorithm,  such  that,  at  any  bit  interval. 

u;j(i)  =  min{tyi(i).  uj2(i)}  ;  =  1.2  (10) 

The  restriction  effectively  prevents  an  increase  of  the  weight  that  affects  the  signal  with  the 
very  large  input  SNR;  the  one  that  does  not  need  the  interference  canceier  in  the  first  place. 
The  effect  of  the  constraint  can  be  observed  if,  under  the  same  assumptions  described  above, 
the  larger  of  the  weights,  W02,  is  replaced  by  the  smaller  one,  luoi  ^  py/M-,  resulting  in  the 
second  output,  1/2  **  (1  —  p)y/Mb2  +  py/A\b\  +  712-  This  certainly  will  not  be  worse  than  the 
output  that  results  when  no  constraint  is  imposed.  The  amount  of  improvement  depends  on 
the  desired  component  to  the  residual  interference  ratio  at  the  output,  [(1  —  p)/p]^A5.V/?. 

Another  possible  constraint  considered  was  in  “disabling”  the  canceling  loop  that  contains 


217 


the  larger  weight  element,  such  that 


max{u;i(t),  u;2(i)}  =  0  (11) 

In  the  above  scenario,  it  meains  xui  =  0,  which  corresponds  to  detecting  the  data  bits  of 
user  2,  the  one  with  the  larger  input  SNR,  directly  from  the  correlator  output. 


III.  ERROR  PERFORMANCE 

The  error  probability  at  the  canceler’s  output  is  evaluated  as  follows.  The  bit  estimates 
at  the  output  are  defined  as: 

6i  =  sgn[y,]  and  62  =  sgn[y2|  (12) 

The  two-user  output  error  probabilites  Poi(e)  and  Po2(^)  are  the  conditional  error  prob¬ 
abilities  averaged  over  61,  62,  and  62.  and  over  61,  62,  and  61,  respectively.  For  user  1: 

error|6i,62,<^} 

=  -  ^  [Pr{ni  >  4-  W\o^) 

■\-Pr{ni  <  —\JAi  —  p\J~A2^  +  <^io^)] 

=  \  Pr{ni  >  yJ~Ax+  p  \fA2  —  Wio.  riz  <  +  P\fM) 

-I-  Pr{nx  >  \fA\  -  pyjM  —  wio,  U2  <  +  p\f^) 

+  PH^\  >  +  Py^M  +  u-’io,  n2  >  yfM  -I-  p 

Pr{nx>  xfAx- pyJT2  +  wxo,n2> -yfM^  pyfAx'^  (13) 

Similarly,  the  error  probability  Pj,  for  user  2  is: 

2  ^^(^2  >  ^<[^2  +  Pyf^x  —  *i’20i  <  yf^x  +  p\J~A2) 

+  Pr(n2  >  \[m  -  pyf^x  -  u;2o,  Mi  <  -yfAx  -f-  pyfM) 


218 


(14) 


+  Pr{n2  >  \fAi  +  P\fAi  +  >  \p^\  +  P\j~^2) 

+  Pr{n2  >  \[A2  -  P\fM  +  i«20,  rii  >  —yfA\  + 

When  the  constraint  from  either  (10)  or  (11)  is  taken  into  account,  the  weights  w\o  and 
W20  in  the  above  expressions  should  be  modified  accordingly. 

Numerical  results  from  the  computation  of  the  error  probabilities  are  presented  as  func¬ 
tions  of  signal  to  noise  ratios  and  the  crosscorrelation  coefficient.  The  error  performance 
of  the  conventional  receiver  is  also  presented  in  order  to  illustrate  its  vulnerability  to  the 
near-far  problem.  In  addition,  the  error  curves  for  the  decorrelating  detector  and  the  system 
presented  in  [5],  where  the  exact  knowledge  of  the  received  signal  energies  w«is  assumed,  are 
included  for  comparison. 

The  error  probability  curves  are  plotted  versus  the  difference  of  the  two  input  SNRs. 
ASNR  =  SNR2  —  SNRi,  with  SNRi  kept  constant.  Three  different  crosscorrelation  coef¬ 
ficient  values,  p  —  0.7,  p  =  0.5,  and  p  —  IjZ  are  considered;  the  first  corresponding  to  the 
high  bandwidth  efficiency  system.  As  mentioned  previously,  a  constraint  on  the  weights  is 
also  added  to  prevent  possible  cancelation  of  the  larger  desired  signal  component  at  one  of 
the  outputs. 

In  Fig.  2  we  use  p  =  0.7  and  AS  NR  in  the  range  from  -4  dB  to  12  dB.  .As  expected, 
the  performance  of  user  1  is  virtually  the  same  regardless  of  the  constraint  strategy  used. 
The  error  performance  of  user  2,  with  no  weight  constraints  imposed,  is  very  poor  as  could 
have  been  predicted.  Marginal  improvement  occurs  at  high  values  of  ASNR  when  the 
constraint  from  (10)  is  imposed.  However,  by  using  the  constraint  from  (11)  instead,  excellent 
performance  for  both  users  is  achieved,  which  is  even  better  than  the  results  in  [5]. 

Fig.  3  is  the  same  except  for  p  =  0.5.  Here  we  observe  that  the  constraint  from  (10) 
provides  better  performance  of  user  2  than  with  the  previous  value  of  p.  Again,  as  expected, 
the  performance  of  user  1  is  virtually  the  same  as  in  [5].  This  is  a  result  of  the  factor 
[(1  —  p)/p]^  being  greater  for  this  case. 
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Fig.  4  depicts  the  case  for  p  =  1/3.  Without  the  constraint  on  the  weights,  there  is  a  range 
of  the  values  of  AS  NR  for  which  the  system  performs  very  well.  Notice  the  deterioration  in 
performance  of  user  2  for  very  high  ASNR  due  to  the  circumstances  {p^SNR^  >  SNRi) 
mentioned  in  the  previous  section. 

With  the  constraint  from  (10)  in  place,  the  performance  of  user  2  matches  the  one  ob¬ 
tained  in  [5].  There  is  a  slight  performance  degradation  for  user  1  over  a  limited  range  of 
ASNRs  when  the  constraint  is  imposed. 

IV.  CONCLUSION 

A  two-stage  detector  for  multiple  access  systems  that  does  not  require  knowledge  of  the 
received  signals’  energies  was  proposed  and  analyzed.  It  incorporates  an  interference  can- 
celer  whose  weights  are  obtained  by  an  iterative  algorithm.  It  was  shown  that  the  receiver 
has  comparable  error  performance  in  near-far  situations  to  similar  receivers  that  assume  the 
knowledge  of  the  signal  energies. 


V.  APPENDIX 


-h  p\fA2b2  -b  Ui]} 

=  -  ^  6i  [Pr{ni  >  —yJ~A\hi  —  ^^^62} 

—  Pr{ni  < 

-1 

\  /  \  } 


V  J  [  ypW 


Eihh}  =  £^61,63  { 61  ■sgn(yA^62  +  Py/^ibi  +  n2]} 
=  ^  [^r{n2  >  -7^62  -  py/Tibi) 
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where; 


and: 


~PT{n2  <  -\fA2b2  -  Pv^^i}] 

—  ni  \/^  ~  Py/M\  _^(  VM  +  py/M\ 

V  I  \  1/^  / 

E{ni^}  =  E{nisgn{yfMb2  +  p\fMK  +  n^)} 


fn\,ni 


TTiVoVl  - 


exp 


n\-\-n\-  2pnin2 

NoH-p^) 
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Rg.  2  Error  probabilities  for  users  1  and  2  with  p  =  0.7  and  SNRl  *  8dB 
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Hg.  3  Error  probabilities  for  users  1  and  2  with  p  =  0  J  and  SNRl  »  8dB 


